-- Logs begin at Tue 2022-09-13 12:13:25 UTC, end at Tue 2022-09-13 13:26:39 UTC. -- Sep 13 12:56:08.055973 dv-cinder-801354-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 12:56:08.064987 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 12:56:08 2022] *** Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: nodename: dv-cinder-801354-10-iscsi Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: machine: x86_64 Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: clock source: unix Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: pcre jit disabled Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: detected number of CPU cores: 4 Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: current working directory: / Sep 13 12:56:08.067053 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: detected binary path: /usr/bin/uwsgi-core Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: your processes number limit is 47680 Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: your memory page size is 4096 bytes Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: detected max file descriptor number: 2048 Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: lock engine: pthread robust mutexes Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: thunder lock: enabled Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 12:56:08.067758 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 12:56:08.106229 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: Python main interpreter initialized at 0x55be242549c0 Sep 13 12:56:08.106229 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: python threads support enabled Sep 13 12:56:08.106229 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: your server socket listen backlog is limited to 100 connections Sep 13 12:56:08.106229 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: your mercy for graceful operations on workers is 90 seconds Sep 13 12:56:08.106581 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 12:56:08.106655 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: *** Operational MODE: preforking *** Sep 13 12:56:08.106881 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: *** uWSGI is running in multiple interpreter mode *** Sep 13 12:56:08.106881 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: spawned uWSGI master process (pid: 106065) Sep 13 12:56:08.107068 dv-cinder-801354-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 12:56:08.108426 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: spawned uWSGI worker 1 (pid: 106066, cores: 1) Sep 13 12:56:08.108426 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: spawned uWSGI worker 2 (pid: 106067, cores: 1) Sep 13 12:56:08.108426 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 12:56:08.759379 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 12:56:08.766220 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 12:56:09.845581 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:56:09.845581 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: from cryptography.utils import int_from_bytes Sep 13 12:56:09.846225 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:56:09.846225 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: from cryptography.utils import int_from_bytes Sep 13 12:56:09.847988 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:56:09.847988 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: from cryptography.utils import int_from_bytes Sep 13 12:56:09.848411 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:56:09.848411 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: from cryptography.utils import int_from_bytes Sep 13 12:56:12.330632 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:56:12.331268 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:56:12.331410 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:56:12.331767 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:56:12.332021 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:56:12.332400 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.332581 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:56:12.332969 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.333061 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:56:12.333146 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.333324 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.333410 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:56:12.333648 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.333793 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:56:12.333982 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:56:12.334077 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.334295 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.334386 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.334606 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.334702 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.334928 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335020 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335186 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335277 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335497 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335610 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335815 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-10-iscsi {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.335906 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336131 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336227 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336522 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336739 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.336843 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337050 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337148 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337350 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337436 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337666 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337788 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-10-iscsi {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.337993 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.338087 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.338335 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.338485 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.338646 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.339617 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.339780 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.339905 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340231 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340440 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340574 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340703 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340835 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.340964 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341092 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341240 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341496 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341627 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341788 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.341930 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342063 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342192 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342328 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342458 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342579 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-10-iscsi {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342712 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342845 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.342980 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343103 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343229 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343348 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343477 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343598 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343719 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343847 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.343983 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-10-iscsi {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344110 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344241 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344385 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344595 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344723 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344855 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.344977 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345107 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345230 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345396 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345532 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345707 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.345829 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346053 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346151 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346377 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346488 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346682 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346775 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.346987 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347091 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347301 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347408 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347600 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347687 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.347900 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348003 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348148 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348256 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348448 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348547 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348763 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.348862 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349078 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349395 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349486 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349641 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349764 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.349912 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350001 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350225 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350323 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350634 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350842 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.350938 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351142 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351243 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351419 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351515 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351674 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351762 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.351993 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352092 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352306 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352398 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352604 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352696 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352904 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.352998 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353208 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353294 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353514 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353606 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353843 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.353961 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354147 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354257 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354448 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354540 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354754 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.354841 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355068 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355161 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355370 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355467 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355717 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.355807 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356026 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356113 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356346 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356499 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356739 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356833 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.356991 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357123 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357299 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357427 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357638 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357732 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.357984 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358082 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358295 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358393 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358614 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358701 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.358935 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359020 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359180 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359281 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359477 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359570 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359777 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.359878 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360090 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360188 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360392 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360487 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360694 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360789 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.360989 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361085 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361282 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361373 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361581 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361675 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361907 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.361997 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362215 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362303 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362516 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362602 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362817 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.362905 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363116 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363208 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363413 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363498 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363715 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.363807 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364014 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364099 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364314 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364423 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364615 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.364707 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365115 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365209 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365209 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365370 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365509 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365604 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365832 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.365922 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366135 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366227 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366449 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366537 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366750 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.366835 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367051 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367141 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367356 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367442 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367655 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367741 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.367954 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368048 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368266 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368364 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368575 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368695 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368877 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.368984 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369190 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369281 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369487 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369579 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369838 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.369943 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370162 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370253 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370465 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370562 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370767 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.370960 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.371103 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.371198 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.371907 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372000 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372254 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372364 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372510 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372596 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372813 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.372909 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373163 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373338 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373486 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373630 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373811 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.373969 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374177 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374333 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374333 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374626 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374766 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.374911 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.375079 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.375218 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.375354 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.375503 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.375649 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.375878 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.376033 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.376172 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.376315 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.376459 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.376602 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.376774 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.376925 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.377077 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.377299 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.377444 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:56:12.377587 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.377756 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.377917 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378064 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378208 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378352 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378490 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378639 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378777 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.378925 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379064 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379208 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379354 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379491 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379627 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379773 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.379910 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380047 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380329 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380465 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380622 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380783 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.380928 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381078 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381223 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381369 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381513 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381650 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381816 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.381971 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382156 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382302 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382476 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382631 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382781 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.382927 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383103 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383249 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383414 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383566 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383734 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.383891 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384063 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384230 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384386 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384524 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384685 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384823 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.384959 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385096 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385272 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385423 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385571 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385709 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.385901 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.386121 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.386371 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.386515 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.386669 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.386818 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.387614 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.387842 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.387988 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388272 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388410 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388555 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388693 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388830 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.388980 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389117 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389254 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389401 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389547 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389684 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.389872 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390013 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390150 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390287 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390423 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390561 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390706 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390844 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.390980 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391117 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391271 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391409 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391554 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391692 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.391870 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.392014 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.392195 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.392483 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.392644 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.392818 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.393053 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.393197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.393440 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.393592 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.393733 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394071 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394214 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394376 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394522 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394752 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.394895 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395033 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395169 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395306 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395443 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395603 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395741 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.395880 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.396184 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.396344 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.396483 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.396806 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.396953 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397113 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397262 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397422 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397575 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397714 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.397981 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398128 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398265 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398403 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398553 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398692 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398829 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.398968 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.399104 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.399241 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.399490 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.399636 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.399834 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.400079 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.400233 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.400451 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.400604 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.400742 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.401052 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.401198 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.401369 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.401684 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.401878 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.402018 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.402311 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.402466 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.402688 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.402921 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403077 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403318 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403462 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403632 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403776 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.403968 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404120 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404301 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404454 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404592 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404746 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.404922 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405076 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405249 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405394 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405567 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405730 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.405920 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.406166 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.406399 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.406542 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.406781 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.406935 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.407085 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.407367 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.407519 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.407704 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.407897 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408132 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408287 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408425 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408562 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408760 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.408913 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.409137 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.409350 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.409506 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.409644 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.409857 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410012 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410150 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410287 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410431 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410570 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410721 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.410872 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411010 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411153 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411314 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411466 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411611 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411764 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.411916 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412067 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412217 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412361 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412510 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412664 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412830 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.412989 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413132 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413297 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413456 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413601 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413785 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.413937 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414097 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414241 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414393 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414538 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414689 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.414833 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415052 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415199 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415361 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415508 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415650 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415795 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.415949 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416100 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416259 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416425 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416639 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416788 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.416939 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417092 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417244 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417398 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417542 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417685 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.417875 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.418033 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.418762 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.418908 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419045 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419181 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419324 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419475 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419613 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419758 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.419907 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420044 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420187 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420333 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420478 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420616 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420752 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.420894 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421057 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421213 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421509 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421673 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.421874 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422029 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422168 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422304 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422450 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422626 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422771 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.422917 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423056 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423238 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423392 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423569 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423760 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.423916 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424054 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424329 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424489 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424634 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.424803 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425090 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425237 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425383 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425537 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425808 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.425974 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426118 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426263 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426418 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426561 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426778 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.426930 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427074 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427227 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427372 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427516 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427758 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427911 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.427911 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.428195 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.428340 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.428483 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.428635 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.428796 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429015 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429164 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429315 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429469 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429621 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429806 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.429964 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430126 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430272 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430489 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430648 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430793 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.430998 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.431149 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.431370 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.431529 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.431690 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.431903 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432063 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432278 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432445 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432599 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432845 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.432997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.433187 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.433338 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.433481 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.433640 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.434504 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.434661 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.434806 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.434958 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435209 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435361 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435504 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435650 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435801 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.435952 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436111 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436265 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436410 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436554 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436704 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.436862 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437015 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437177 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437321 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437464 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437607 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437792 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437956 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.437956 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438231 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438382 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438525 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438677 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438832 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.438990 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.439215 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.439372 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.439516 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.439725 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.439877 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440020 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440233 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440385 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440629 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440788 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.440941 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.441141 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.441291 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.441516 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.441666 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.441859 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.442079 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.442231 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.442434 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.442585 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443003 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443156 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443332 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443484 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443634 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443788 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.443941 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.444093 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.444282 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.444444 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.444597 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.444881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445039 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445212 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445434 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445592 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445762 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.445915 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446069 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446229 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446381 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446693 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446845 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.446989 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447131 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447285 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447443 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447591 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447735 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.447886 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448045 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448200 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448369 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448521 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448721 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.448872 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.449017 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.449280 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.449441 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.449675 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.449954 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450145 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450320 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450475 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450621 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450764 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.450915 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451105 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451266 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451412 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451579 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451730 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.451983 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.452133 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.452356 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.452517 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.452669 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.452887 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453040 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453208 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453372 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453518 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453660 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.453869 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454028 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454186 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454331 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454475 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454637 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454782 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.454925 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455077 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455227 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455379 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455615 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455765 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.455909 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456062 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456213 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456364 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456507 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456671 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456816 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.456972 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457117 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457261 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457405 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457548 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457716 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.457933 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458038 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458271 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458401 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458582 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458870 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.458973 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.459174 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.459385 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.459474 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.459767 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.459865 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460071 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460236 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460369 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460662 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460756 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.460961 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.461137 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.461272 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.461571 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.461656 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.461959 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462128 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462230 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462454 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462549 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462772 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.462868 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463069 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463155 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463388 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463475 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463694 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463792 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.463994 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464087 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464292 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464379 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464595 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464690 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.464893 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.465048 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.465285 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.465450 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.465632 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.465980 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466135 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466279 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466422 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466566 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466721 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.466866 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467017 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467162 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467316 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467460 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467611 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467755 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.467906 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468050 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468193 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468336 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468486 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468637 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468780 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.468923 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469065 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469229 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469373 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469598 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469768 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.469919 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470062 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470219 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470363 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470507 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470650 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470792 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.470935 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471097 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471253 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471398 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471549 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471694 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471836 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.471988 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472133 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472275 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472419 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472562 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472725 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.472871 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473014 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473167 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473311 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473455 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473606 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473775 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.473936 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474081 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474224 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474367 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474519 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474663 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474807 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.474950 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475103 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475247 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475399 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475552 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475696 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.475840 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476007 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476228 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476378 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476530 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476681 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476825 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.476990 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477143 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477294 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477438 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477591 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477762 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.477915 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478074 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478219 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478362 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478504 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478648 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478798 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.478798 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479092 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479234 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479377 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479526 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479761 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.479912 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.480063 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.480207 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.480350 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.480492 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.481127 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.481339 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.481603 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.481839 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.481998 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482143 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482367 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482514 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482668 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482815 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.482959 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483102 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483256 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483400 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483544 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483706 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.483852 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484004 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484149 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484300 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484451 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484603 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484754 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.484908 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485053 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485197 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485340 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485494 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485637 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485823 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.485983 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.486129 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.486379 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.486575 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.486731 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.486885 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487031 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487181 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487332 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487477 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487631 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487783 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.487928 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488087 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488232 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488375 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488527 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488672 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488816 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.488959 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489103 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489253 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489405 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489558 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489702 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.489880 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490025 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490170 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490325 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490469 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490620 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490763 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.490914 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491067 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491213 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491356 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491509 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491660 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491804 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.491957 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492101 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492396 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492556 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492704 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.492857 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493000 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493000 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493283 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493283 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493564 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493724 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493905 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.493905 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494178 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494178 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494462 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494607 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494750 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.494893 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495035 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495199 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495352 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495497 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495640 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495788 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.495932 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.496082 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.496238 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.497187 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.497345 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.497491 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.497635 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.497866 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498040 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498187 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498345 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498490 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498644 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498789 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.498932 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499076 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499229 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499380 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499525 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499670 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499824 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.499977 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500122 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500273 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500417 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500562 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500707 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.500869 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501014 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501158 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501309 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501453 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501604 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501805 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.501957 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502102 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502246 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502390 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502534 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502696 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502843 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.502987 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503132 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503275 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503419 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503738 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.503883 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504026 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504169 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504322 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504467 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504611 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504754 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.504899 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505049 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505205 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505351 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505504 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505658 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505658 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.505996 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506152 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506298 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506449 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506594 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506738 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.506895 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507041 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507269 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507421 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507585 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507775 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.507939 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508093 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508238 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508382 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508525 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508668 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508829 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.508980 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509126 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509269 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509413 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509575 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509728 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.509898 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510044 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510187 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510331 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510486 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510631 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510781 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.510926 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511069 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511220 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511377 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511541 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511686 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.511830 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512004 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512149 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512302 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512454 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512598 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512752 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.512896 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513039 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513338 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513500 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513500 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513807 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.513970 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514116 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514261 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514405 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514548 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514692 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514844 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.514989 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515133 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515287 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515446 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515598 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515755 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.515900 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516044 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516187 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516331 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516474 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516626 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516771 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.516916 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517066 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517221 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517465 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517617 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517785 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.517936 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518080 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518223 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518377 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518523 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518667 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518810 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.518953 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519096 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519262 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519415 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519561 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519711 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519855 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.519999 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520152 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520296 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520440 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520585 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520728 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.520915 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521060 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521224 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521375 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521375 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521650 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.521850 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522008 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522152 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522296 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522447 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522598 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522762 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.522914 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523069 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523213 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523357 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523500 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523652 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523798 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.523949 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524093 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524236 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524391 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524537 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524680 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524833 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.524995 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525139 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525295 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525441 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525584 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525728 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.525912 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526057 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526210 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526355 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526497 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526640 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526802 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.526956 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.527100 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.527244 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.527394 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.527670 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.527821 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528048 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528195 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528340 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528483 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528483 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528833 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.528991 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529136 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529281 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529431 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529584 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529760 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.529924 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530071 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530222 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530367 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530512 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530666 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530828 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.530973 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531125 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531270 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531423 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531583 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531729 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.531890 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532037 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532183 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532337 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532482 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532643 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532792 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.532937 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533080 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533234 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533380 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533524 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533675 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533847 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.533993 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534150 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534297 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534450 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534594 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534742 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.534959 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535105 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535259 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535410 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535561 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535706 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.535859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536011 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536156 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536315 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536460 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536603 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536760 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.536905 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537057 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537210 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537356 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537509 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537680 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.537908 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538056 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538211 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538368 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538523 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538668 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538818 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538964 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.538964 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539244 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539401 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539547 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539707 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539853 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.539997 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540161 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540315 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540461 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540461 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540734 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.540878 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541032 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541177 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541327 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541471 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541616 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541793 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.541957 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542113 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542257 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542401 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542545 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542699 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542854 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.542999 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.543669 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.543817 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.543968 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544122 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544267 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544418 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544572 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544717 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.544861 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545013 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545157 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545301 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545445 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545588 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545754 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.545925 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546071 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546215 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546369 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546512 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546656 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546814 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.546814 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547097 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547240 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547391 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547545 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547690 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547834 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.547978 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548121 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548292 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548495 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548645 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548790 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.548935 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549078 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549221 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549377 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549522 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549666 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.549875 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550033 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550178 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550345 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550490 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550642 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550788 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.550932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551086 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551239 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551383 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551535 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551680 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551824 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.551976 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552122 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552282 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552426 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552577 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552731 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.552887 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553032 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553176 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553176 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553450 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553593 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553766 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.553918 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554072 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554228 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554372 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554529 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554681 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554825 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.554968 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555112 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555257 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555418 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555564 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555708 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.555852 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556013 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556158 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556312 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556456 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556601 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556745 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.556888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557032 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557186 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557330 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557482 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557627 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557792 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.557965 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.558112 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.558263 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.558408 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.558558 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.558734 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.559658 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.559806 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.559958 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560104 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560248 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560393 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560563 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560709 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560852 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.560997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.561142 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.561300 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.561522 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.561683 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.561889 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562043 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562217 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562380 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562528 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562688 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562837 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.562981 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563124 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563277 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563422 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563567 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563710 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563854 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.563997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564215 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564362 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564528 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564682 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564834 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.564987 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.565132 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.565276 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.565538 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.565692 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.565887 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566043 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566196 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566347 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566498 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566654 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566799 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.566952 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567097 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567248 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567393 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567538 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567690 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567836 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.567987 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568137 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568281 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568432 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568585 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568729 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.568908 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569061 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569230 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569381 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569534 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569685 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.569901 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570049 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570356 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570501 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570651 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570803 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.570948 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571101 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571255 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571408 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571553 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571697 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571841 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.571985 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572137 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572306 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572451 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572594 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572747 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.572911 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573065 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573243 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573396 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573569 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573721 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.573910 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.574058 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.574231 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.574449 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.574623 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.574881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575042 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575218 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575369 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575513 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575656 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575801 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.575958 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576103 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576256 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576411 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576563 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576721 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.576872 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577017 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577163 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577307 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577450 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577604 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577813 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.577976 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578122 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578421 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578574 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578719 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.578863 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579007 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579151 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579303 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579449 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579599 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579750 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.579901 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580045 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580207 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580353 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580497 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580691 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580846 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.580997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581151 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581296 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581441 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581584 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581727 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.581901 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582057 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582218 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582508 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582652 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582805 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.582962 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583112 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583264 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583408 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583553 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583705 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583849 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.583994 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584154 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584299 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584444 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584602 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584747 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.584891 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585035 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585178 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585330 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585488 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585634 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585809 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.585971 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586115 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586276 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586422 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586566 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586711 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586855 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.586998 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587151 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587304 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587449 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587593 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587738 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.587894 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588048 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588336 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588480 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588631 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588791 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.588943 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589087 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589240 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589385 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589529 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589691 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.589877 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.590068 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.590216 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.590361 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.590633 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.590892 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591050 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591195 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591341 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591495 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591640 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591794 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.591950 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.592093 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.592238 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.592389 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.592610 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:56:12.592758 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.592758 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.593086 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.593404 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.593726 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.594085 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.594402 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.594716 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.595030 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.595342 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.595654 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.595973 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.596286 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.596599 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.596915 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.597231 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.597561 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.597912 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.598227 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.598564 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.598893 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.599241 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.599558 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.599904 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.600236 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.600554 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.600869 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.601183 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:56:12.601429 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:56:12.744349 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO dbcounter [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Registered counter for database nova_api Sep 13 12:56:12.755846 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO dbcounter [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Registered counter for database nova_api Sep 13 12:56:12.765822 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_db.sqlalchemy.engines [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.772294 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writer thread running {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:12.777896 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_db.sqlalchemy.engines [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.784455 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writer thread running {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:12.829178 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.context [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f147bbc8-2c91-4f66-bc06-a2f2b3222893(cell1) {{(pid=106066) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 12:56:12.833077 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 12:56:12.833483 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 12:56:12.835074 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 12:56:12.835778 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 12:56:12.836213 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 12:56:12.838192 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 12:56:12.840681 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO dbcounter [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Registered counter for database nova_cell0 Sep 13 12:56:12.842369 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.context [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f147bbc8-2c91-4f66-bc06-a2f2b3222893(cell1) {{(pid=106067) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 12:56:12.844933 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO dbcounter [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Registered counter for database nova_cell1 Sep 13 12:56:12.846200 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 12:56:12.846672 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 12:56:12.848238 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 12:56:12.848971 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 12:56:12.849406 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 12:56:12.851447 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_concurrency.lockutils [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 12:56:12.852533 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_db.sqlalchemy.engines [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.853476 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO dbcounter [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Registered counter for database nova_cell0 Sep 13 12:56:12.854781 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_db.sqlalchemy.engines [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.858131 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO dbcounter [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Registered counter for database nova_cell1 Sep 13 12:56:12.860986 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writer thread running {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:12.862785 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writer thread running {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:12.864920 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_db.sqlalchemy.engines [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.866607 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_db.sqlalchemy.engines [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:12.873168 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writer thread running {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:12.875424 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writer thread running {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:13.010574 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO dbcounter [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Registered counter for database nova_cell0 Sep 13 12:56:13.019504 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_db.sqlalchemy.engines [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:13.024158 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writer thread running {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:13.027256 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO dbcounter [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Registered counter for database nova_cell0 Sep 13 12:56:13.037427 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG oslo_db.sqlalchemy.engines [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:56:13.041885 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writer thread running {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:56:13.434849 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: WARNING keystonemiddleware.auth_token [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 12:56:13.442126 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: WARNING keystonemiddleware.auth_token [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 12:56:13.453345 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: WARNING keystonemiddleware.auth_token [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 12:56:13.460626 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: WARNING keystonemiddleware.auth_token [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 12:56:13.783495 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: WARNING keystonemiddleware.auth_token [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 12:56:13.789399 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: WARNING keystonemiddleware.auth_token [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 12:56:13.795075 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be242549c0 pid: 106066 (default app) Sep 13 12:56:13.797100 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:56:13.798310 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Sep 13 12:56:13.798725 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Tue Sep 13 12:56:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:56:13.801220 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: WARNING keystonemiddleware.auth_token [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 12:56:13.807204 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: WARNING keystonemiddleware.auth_token [None req-32e196b4-33e9-437d-8ad3-7276e46ad08d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 12:56:13.813346 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55be242549c0 pid: 106067 (default app) Sep 13 12:57:38.581387 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:38.582425 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 13 12:57:38.582813 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 12:57:38.595422 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_api:SELECT=3 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:38.600534 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_cell1:SELECT=3 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:38.600534 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_cell0:SELECT=3 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:38.600534 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:39.457765 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-c3476073-3767-4e11-b816-fd93fe60a45f admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:39.491392 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-c3476073-3767-4e11-b816-fd93fe60a45f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901159 Sep 13 12:57:39.493787 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1292 bytes} [Tue Sep 13 12:57:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 12:57:42.136103 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:42.137098 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-c336197d-710d-4e84-be9e-d592311e8779 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Sep 13 12:57:42.137686 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:42.600990 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-3884e3f5-721b-4bf5-a816-f2acb2f582bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:42.725293 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-3884e3f5-721b-4bf5-a816-f2acb2f582bc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581684 Sep 13 12:57:42.726262 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:57:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 12:57:42.740347 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_api:SELECT=3 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:42.741166 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_cell1:SELECT=3 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:42.743074 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_cell0:SELECT=3 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:42.743823 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:57:42.960868 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-7c04f4b9-0a75-4abf-974e-dcb1e284e8dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:43.071312 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-7c04f4b9-0a75-4abf-974e-dcb1e284e8dc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.336086 Sep 13 12:57:43.072836 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1336 bytes} [Tue Sep 13 12:57:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:57:45.731065 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-3884e3f5-721b-4bf5-a816-f2acb2f582bc admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:45.732702 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-3884e3f5-721b-4bf5-a816-f2acb2f582bc admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Sep 13 12:57:45.733093 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:46.373265 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-77b4849f-9a8f-48a0-b533-787b8e8c43e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:46.493681 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-77b4849f-9a8f-48a0-b533-787b8e8c43e9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.754327 Sep 13 12:57:46.494798 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:57:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 12:57:46.507179 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-7477da73-fdcd-4aed-b468-61f44a3d6a46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:46.646594 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-7477da73-fdcd-4aed-b468-61f44a3d6a46 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143022 Sep 13 12:57:46.647532 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1336 bytes} [Tue Sep 13 12:57:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 12:57:49.266592 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-77b4849f-9a8f-48a0-b533-787b8e8c43e9 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:49.267613 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-77b4849f-9a8f-48a0-b533-787b8e8c43e9 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 13 12:57:49.268338 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:49.685422 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-9b9c0a0e-49ea-4b75-97f3-b40279fd7844 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:49.747969 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-9b9c0a0e-49ea-4b75-97f3-b40279fd7844 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469060 Sep 13 12:57:49.747969 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:57:49.757005 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-de463b34-4a3e-4d5c-bd12-2da9ae15823d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:49.882759 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-de463b34-4a3e-4d5c-bd12-2da9ae15823d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129563 Sep 13 12:57:49.883377 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1336 bytes} [Tue Sep 13 12:57:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:57:52.489978 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-9b9c0a0e-49ea-4b75-97f3-b40279fd7844 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:52.490975 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-9b9c0a0e-49ea-4b75-97f3-b40279fd7844 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 13 12:57:52.491564 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:52.945747 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-22d8fa09-1902-46d6-b400-dd4fb0f84e2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:53.024329 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-22d8fa09-1902-46d6-b400-dd4fb0f84e2d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526406 Sep 13 12:57:53.025245 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:57:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 12:57:53.038051 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-c1c8e54a-c25b-4c36-8ba6-b8f8c55bc1f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:53.138038 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-c1c8e54a-c25b-4c36-8ba6-b8f8c55bc1f6 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103833 Sep 13 12:57:53.138711 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1336 bytes} [Tue Sep 13 12:57:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:57:55.800839 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-22d8fa09-1902-46d6-b400-dd4fb0f84e2d admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:55.801880 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-22d8fa09-1902-46d6-b400-dd4fb0f84e2d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 13 12:57:55.802276 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:56.213434 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:56.371317 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562277 Sep 13 12:57:56.371879 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:57:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:57:56.383852 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-c4680c71-051f-4bf8-9c21-73f9c996f4b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:57:56.450737 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-c4680c71-051f-4bf8-9c21-73f9c996f4b9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070414 Sep 13 12:57:56.451355 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1336 bytes} [Tue Sep 13 12:57:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:57:59.027658 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:59.028669 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 13 12:57:59.029069 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:57:59.437914 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-2fde14c9-7af3-4093-8521-5677c146c6d0 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:57:59.470654 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-2fde14c9-7af3-4093-8521-5677c146c6d0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435314 Sep 13 12:57:59.471698 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1292 bytes} [Tue Sep 13 12:57:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:02.097682 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:02.098728 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-54fbd7ca-7402-4af5-a1d8-fb67b243f04f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 13 12:58:02.099123 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:02.493367 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-b67cce69-5e0d-426f-ba39-7b2a339ddb02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "ram": 512}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:02.582399 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-b67cce69-5e0d-426f-ba39-7b2a339ddb02 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477056 Sep 13 12:58:02.582973 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:58:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:02.594881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-69f639cc-5b2e-4c08-96c9-e837046b9b85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:02.730808 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-69f639cc-5b2e-4c08-96c9-e837046b9b85 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139527 Sep 13 12:58:02.731403 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1333 bytes} [Tue Sep 13 12:58:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:58:05.365532 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-b67cce69-5e0d-426f-ba39-7b2a339ddb02 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:05.366568 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-b67cce69-5e0d-426f-ba39-7b2a339ddb02 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 13 12:58:05.366973 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:05.776285 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-3c590e7b-c26c-4e66-bd0c-78074e9548f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:05.868572 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-3c590e7b-c26c-4e66-bd0c-78074e9548f4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494093 Sep 13 12:58:05.869131 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:58:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 12:58:05.881170 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-a8007ada-9035-4374-bbd6-126406d8b60f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:05.981954 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-a8007ada-9035-4374-bbd6-126406d8b60f admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104367 Sep 13 12:58:05.982537 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1333 bytes} [Tue Sep 13 12:58:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:58:08.662637 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-3c590e7b-c26c-4e66-bd0c-78074e9548f4 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:08.663641 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-3c590e7b-c26c-4e66-bd0c-78074e9548f4 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 13 12:58:08.664041 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:09.109377 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-36237109-74ee-4dce-a2ac-a2cbbfcaebef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:09.210739 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-36237109-74ee-4dce-a2ac-a2cbbfcaebef admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.540498 Sep 13 12:58:09.211609 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:58:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:09.224798 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-2dd67ace-d79b-434b-89e1-d1569fbe6336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:09.229887 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:58:09.353241 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-2dd67ace-d79b-434b-89e1-d1569fbe6336 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131542 Sep 13 12:58:09.365795 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1333 bytes} [Tue Sep 13 12:58:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:58:12.011000 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-36237109-74ee-4dce-a2ac-a2cbbfcaebef admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:12.012011 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-36237109-74ee-4dce-a2ac-a2cbbfcaebef admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 13 12:58:12.012650 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:12.471361 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-99ec703d-03fc-4f85-b22d-f385ceac07f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:12.582836 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-99ec703d-03fc-4f85-b22d-f385ceac07f1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.564137 Sep 13 12:58:12.583665 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:58:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:12.596256 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-d68d4b74-1153-44df-a4d5-677bdca49832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:12.696227 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-d68d4b74-1153-44df-a4d5-677bdca49832 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103438 Sep 13 12:58:12.697830 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1333 bytes} [Tue Sep 13 12:58:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:58:15.361265 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-99ec703d-03fc-4f85-b22d-f385ceac07f1 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:15.362303 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-99ec703d-03fc-4f85-b22d-f385ceac07f1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 12:58:15.365819 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:15.816373 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:15.824518 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:58:15.889790 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519846 Sep 13 12:58:15.897967 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1283 bytes} [Tue Sep 13 12:58:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:15.902533 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b45441d3-f870-4b6a-b19d-9862dee56f25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:15.981527 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b45441d3-f870-4b6a-b19d-9862dee56f25 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082572 Sep 13 12:58:15.985781 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1333 bytes} [Tue Sep 13 12:58:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 12:58:33.284292 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:33.285291 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 13 12:58:33.285687 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:33.297185 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:58:33.679506 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-3a851df6-9472-48e7-ac4b-8164f59c828c admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:33.699776 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-3a851df6-9472-48e7-ac4b-8164f59c828c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407070 Sep 13 12:58:33.700306 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1292 bytes} [Tue Sep 13 12:58:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:34.998297 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:34.999594 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-eb5e066a-0c0b-49b2-9738-4bc87448045b admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Sep 13 12:58:35.000006 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:35.519594 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-c5015aa2-1b29-4210-b18f-594b5213bcb9 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:35.524956 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.wsgi [None req-c5015aa2-1b29-4210-b18f-594b5213bcb9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-c5015aa2-1b29-4210-b18f-594b5213bcb9 admin admin] Request method failure captured: Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept: application/json Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept-Encoding: gzip, deflate Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Connection: keep-alive Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Content-Length: 0 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Host: 10.222.0.72 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-System-Scope: None Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: User-Agent: python-novaclient Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Auth-Token: gAAAAABjIH56ULhSpIaTv5ZZcec6CDyGjI3QcruvBRM8hQFtPq6iJ4tl4pmWKMsSGtD4hZW186GbBjDBrWRDIYWxVEScVe5nfrgbvh2h0mpPNaOi5zmNBl7xdqLoGJhvRtTGTG4LklERFwGWbNUr_QTzDn2SO_hLUc5ViX7Z-WGd70ws3xUD1yg Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Id: None Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Name: None Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Identity-Status: Confirmed Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Is-Admin-Project: True Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Id: default Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Name: Default Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Name: admin Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Role: admin,reader,member Sep 13 12:58:35.528197 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Roles: admin,reader,member Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant: admin Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Name: admin Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User: admin Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Id: default Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Name: Default Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Name: admin Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: method: > Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: exception: Flavor 42 could not be found. Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: action_args: {'id': '42'} Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:35.529921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:35.530936 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.532125 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-c5015aa2-1b29-4210-b18f-594b5213bcb9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:35.533165 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-c5015aa2-1b29-4210-b18f-594b5213bcb9 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393309 Sep 13 12:58:35.533165 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Tue Sep 13 12:58:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:35.539580 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-78509d5b-6ab8-4733-9e15-32a349afc5d2 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:35.563041 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-78509d5b-6ab8-4733-9e15-32a349afc5d2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027119 Sep 13 12:58:35.565456 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:35.574123 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-7e84da24-8bd4-4c5e-b47f-3b8cd4afa319 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:35.595371 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-7e84da24-8bd4-4c5e-b47f-3b8cd4afa319 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025649 Sep 13 12:58:35.595912 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:35.606181 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-35741231-a01b-4597-b746-9f511a2174c0 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:35.611745 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.wsgi [None req-35741231-a01b-4597-b746-9f511a2174c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-35741231-a01b-4597-b746-9f511a2174c0 admin admin] Request method failure captured: Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept: application/json Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept-Encoding: gzip, deflate Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Connection: keep-alive Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Content-Length: 0 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Host: 10.222.0.72 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-System-Scope: None Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: User-Agent: python-novaclient Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Auth-Token: gAAAAABjIH56ULhSpIaTv5ZZcec6CDyGjI3QcruvBRM8hQFtPq6iJ4tl4pmWKMsSGtD4hZW186GbBjDBrWRDIYWxVEScVe5nfrgbvh2h0mpPNaOi5zmNBl7xdqLoGJhvRtTGTG4LklERFwGWbNUr_QTzDn2SO_hLUc5ViX7Z-WGd70ws3xUD1yg Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Id: None Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Name: None Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Identity-Status: Confirmed Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Is-Admin-Project: True Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Id: default Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Name: Default Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Name: admin Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Role: admin,reader,member Sep 13 12:58:35.615084 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Roles: admin,reader,member Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant: admin Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Name: admin Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User: admin Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Id: default Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Name: Default Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Name: admin Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: method: > Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: exception: Flavor 42 could not be found. Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: action_args: {'id': '42'} Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:35.619267 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:35.620252 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:35.621539 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-35741231-a01b-4597-b746-9f511a2174c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:35.622807 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-35741231-a01b-4597-b746-9f511a2174c0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014801 Sep 13 12:58:35.622807 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Tue Sep 13 12:58:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:36.840786 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-7e84da24-8bd4-4c5e-b47f-3b8cd4afa319 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:36.840786 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-7e84da24-8bd4-4c5e-b47f-3b8cd4afa319 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Sep 13 12:58:36.840786 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 12:58:37.362529 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-96897fa9-94c8-4597-b9fa-cadb4daf8e2e admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:37.367477 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.wsgi [None req-96897fa9-94c8-4597-b9fa-cadb4daf8e2e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-96897fa9-94c8-4597-b9fa-cadb4daf8e2e admin admin] Request method failure captured: Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept: application/json Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept-Encoding: gzip, deflate Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Connection: keep-alive Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Content-Length: 0 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Host: 10.222.0.72 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-System-Scope: None Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: User-Agent: python-novaclient Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Auth-Token: gAAAAABjIH58OiguzA22w0z_yqtClRucHlH6fCvUaR-dcEhRkY0z5TMydGEt7aHMDIL5QpmM-vQRIiDAdvRg6mU2u_tpEpQb_GtpA3MzL4-I8ktBOcMLjEQFWh35ZcenoAaPBsPulVSVXAfZu3lvdbfqMW2XG-8IqrRIIJurEFB3k8P8wjLDLkc Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Id: None Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Name: None Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Identity-Status: Confirmed Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Is-Admin-Project: True Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Id: default Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Name: Default Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Name: admin Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Role: admin,reader,member Sep 13 12:58:37.368997 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Roles: admin,reader,member Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant: admin Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Name: admin Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User: admin Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Id: default Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Name: Default Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Name: admin Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: method: > Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: exception: Flavor 84 could not be found. Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: action_args: {'id': '84'} Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:37.370576 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:37.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.373009 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-96897fa9-94c8-4597-b9fa-cadb4daf8e2e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:37.374400 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-96897fa9-94c8-4597-b9fa-cadb4daf8e2e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396011 Sep 13 12:58:37.374400 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Tue Sep 13 12:58:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:37.380128 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-f8632317-f7fa-4b32-a05b-016c7175a550 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:37.395098 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-f8632317-f7fa-4b32-a05b-016c7175a550 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018560 Sep 13 12:58:37.395636 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:37.405270 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-48b4c781-f430-468c-9fc2-4c00b94e69ac admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:37.421014 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-48b4c781-f430-468c-9fc2-4c00b94e69ac admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019205 Sep 13 12:58:37.421535 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:37.430871 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-00b86e12-d09c-4e29-88e8-f86827afbedf admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:37.435757 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.wsgi [None req-00b86e12-d09c-4e29-88e8-f86827afbedf admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-00b86e12-d09c-4e29-88e8-f86827afbedf admin admin] Request method failure captured: Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept: application/json Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept-Encoding: gzip, deflate Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Connection: keep-alive Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Content-Length: 0 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Host: 10.222.0.72 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-System-Scope: None Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: User-Agent: python-novaclient Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Auth-Token: gAAAAABjIH58OiguzA22w0z_yqtClRucHlH6fCvUaR-dcEhRkY0z5TMydGEt7aHMDIL5QpmM-vQRIiDAdvRg6mU2u_tpEpQb_GtpA3MzL4-I8ktBOcMLjEQFWh35ZcenoAaPBsPulVSVXAfZu3lvdbfqMW2XG-8IqrRIIJurEFB3k8P8wjLDLkc Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Id: None Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Name: None Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Identity-Status: Confirmed Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Is-Admin-Project: True Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Id: default Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Name: Default Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Name: admin Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Role: admin,reader,member Sep 13 12:58:37.437237 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Roles: admin,reader,member Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant: admin Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Name: admin Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User: admin Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Id: default Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Name: Default Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Name: admin Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: method: > Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: exception: Flavor 84 could not be found. Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: action_args: {'id': '84'} Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:37.438749 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:37.439881 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:37.441365 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-00b86e12-d09c-4e29-88e8-f86827afbedf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:37.442643 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-00b86e12-d09c-4e29-88e8-f86827afbedf admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011501 Sep 13 12:58:37.442643 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Tue Sep 13 12:58:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:38.660854 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-48b4c781-f430-468c-9fc2-4c00b94e69ac admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:38.661885 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-48b4c781-f430-468c-9fc2-4c00b94e69ac admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 13 12:58:38.662301 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 12:58:39.183031 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-e89f8dbb-5acc-4c78-9b05-7de2382e8ed0 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:39.188844 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.wsgi [None req-e89f8dbb-5acc-4c78-9b05-7de2382e8ed0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-e89f8dbb-5acc-4c78-9b05-7de2382e8ed0 admin admin] Request method failure captured: Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept: application/json Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Accept-Encoding: gzip, deflate Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Connection: keep-alive Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Content-Length: 0 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Host: 10.222.0.72 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Openstack-System-Scope: None Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: User-Agent: python-novaclient Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Auth-Token: gAAAAABjIH5-F30e_3x0NQRHeNwyAXrTDzSnQQRjwUJvB-0oA2Fb3AOctzo9Pnl4fWNz5b2C6qqAd39GCgnCNZEmmgSVlZdpbAHhAPTPt4vxC6ouw6koYcBGIfBcz8ywYW0sJ2BGjVWA2g82CFC9uqcDRap1aTrx60LCQcPKOCFRd1Djg3zn4UY Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Id: None Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Domain-Name: None Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Identity-Status: Confirmed Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Is-Admin-Project: True Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Id: default Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Domain-Name: Default Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Project-Name: admin Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Role: admin,reader,member Sep 13 12:58:39.190363 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Roles: admin,reader,member Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant: admin Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-Tenant-Name: admin Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User: admin Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Id: default Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Domain-Name: Default Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: X-User-Name: admin Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: method: > Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: exception: Flavor 451 could not be found. Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: action_args: {'id': '451'} Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:39.191888 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:39.192859 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.194166 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-e89f8dbb-5acc-4c78-9b05-7de2382e8ed0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:39.195426 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-e89f8dbb-5acc-4c78-9b05-7de2382e8ed0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392278 Sep 13 12:58:39.195426 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 12:58:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:39.202630 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-307e20e7-b2d7-4d7a-9008-6655bd9bab7f admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:39.218560 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-307e20e7-b2d7-4d7a-9008-6655bd9bab7f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019512 Sep 13 12:58:39.219066 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:58:39.228561 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:39.243588 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018713 Sep 13 12:58:39.244146 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Tue Sep 13 12:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 12:58:39.253193 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-19a83759-b3c3-4e2a-abba-82bf0451e504 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:39.258270 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.wsgi [None req-19a83759-b3c3-4e2a-abba-82bf0451e504 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-19a83759-b3c3-4e2a-abba-82bf0451e504 admin admin] Request method failure captured: Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept: application/json Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Accept-Encoding: gzip, deflate Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Connection: keep-alive Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Content-Length: 0 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Host: 10.222.0.72 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-Api-Version: compute 2.92 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Openstack-System-Scope: None Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: User-Agent: python-novaclient Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Auth-Token: gAAAAABjIH5-F30e_3x0NQRHeNwyAXrTDzSnQQRjwUJvB-0oA2Fb3AOctzo9Pnl4fWNz5b2C6qqAd39GCgnCNZEmmgSVlZdpbAHhAPTPt4vxC6ouw6koYcBGIfBcz8ywYW0sJ2BGjVWA2g82CFC9uqcDRap1aTrx60LCQcPKOCFRd1Djg3zn4UY Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Id: None Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Domain-Name: None Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Identity-Status: Confirmed Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Is-Admin-Project: True Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Id: default Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Domain-Name: Default Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Project-Name: admin Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Role: admin,reader,member Sep 13 12:58:39.260336 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Roles: admin,reader,member Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdd5b4a37f1d439babc288358ccc8191", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdd5b4a37f1d439babc288358ccc8191"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant: admin Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Id: cdd5b4a37f1d439babc288358ccc8191 Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-Tenant-Name: admin Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User: admin Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Id: default Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Domain-Name: Default Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Id: 259c064f989f4405a7a84f397fec6223 Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: X-User-Name: admin Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: method: > Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: exception: Flavor 451 could not be found. Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: action_args: {'id': '451'} Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 12:58:39.261932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:39.263024 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: ERROR nova.api.openstack.wsgi Sep 13 12:58:39.264432 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-19a83759-b3c3-4e2a-abba-82bf0451e504 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 12:58:39.265635 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-19a83759-b3c3-4e2a-abba-82bf0451e504 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012001 Sep 13 12:58:39.265635 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 12:58:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 12:58:40.487737 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:40.488742 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 13 12:58:40.489139 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:41.007393 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-fd9685c4-edbf-4603-b346-62151f3582af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:41.101357 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-fd9685c4-edbf-4603-b346-62151f3582af admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.475642 Sep 13 12:58:41.102110 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Tue Sep 13 12:58:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:42.310517 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:42.311537 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 13 12:58:42.311921 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:42.830375 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-6566166a-2106-4a73-8e65-e26ca120b9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:42.924349 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-6566166a-2106-4a73-8e65-e26ca120b9f1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.473399 Sep 13 12:58:42.924894 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Tue Sep 13 12:58:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:44.147188 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:44.148182 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 13 12:58:44.148583 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:44.666836 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-24e15ae8-e3f0-420a-a59a-2e02395f4cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:44.754452 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-24e15ae8-e3f0-420a-a59a-2e02395f4cf7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.467587 Sep 13 12:58:44.755036 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Tue Sep 13 12:58:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 12:58:46.018978 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:46.019970 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 13 12:58:46.020360 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:46.663489 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-c534fddd-c34f-4bb6-b4e2-c0e14921df28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 12:58:46.752562 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-c534fddd-c34f-4bb6-b4e2-c0e14921df28 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.594740 Sep 13 12:58:46.753107 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Tue Sep 13 12:58:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 12:58:47.961910 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:47.962879 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Sep 13 12:58:47.963277 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 12:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:58:48.488965 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-b3bd9d2f-d83c-47d3-b09f-e3c4dc1059d0 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:58:48.510939 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-b3bd9d2f-d83c-47d3-b09f-e3c4dc1059d0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409833 Sep 13 12:58:48.511498 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Tue Sep 13 12:58:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 12:59:45.154597 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.155605 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-05336f82-1cf1-416d-9feb-8fed99f423eb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 13 12:59:45.156272 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 931 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 12:59:45.167131 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:59:45.551132 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-27883975-6a6e-460e-9e53-d1031dae93f2 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.571644 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-27883975-6a6e-460e-9e53-d1031dae93f2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409657 Sep 13 12:59:45.572172 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1292 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 12:59:45.594139 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_api:SELECT=14 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:59:45.597852 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-5f88a155-3133-4705-81b0-6aea1ffb29c0 admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.605523 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-5f88a155-3133-4705-81b0-6aea1ffb29c0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012824 Sep 13 12:59:45.609620 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1283 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 12:59:45.617540 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-2e9b4578-d460-4611-8d7f-f9d5b28e98d1 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.624709 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-2e9b4578-d460-4611-8d7f-f9d5b28e98d1 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010806 Sep 13 12:59:45.625232 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1286 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:59:45.636711 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.644160 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011096 Sep 13 12:59:45.644691 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1286 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 12:59:45.656954 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-95612795-d9e6-454a-8a24-dd3891c071ff admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 12:59:45.664733 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-95612795-d9e6-454a-8a24-dd3891c071ff admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011403 Sep 13 12:59:45.665234 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1283 bytes} [Tue Sep 13 12:59:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:02:54.850929 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:02:54.852447 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Sep 13 13:02:54.852836 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 13:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:02:54.993417 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_api:SELECT=6 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:02:55.149519 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:02:55.154449 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:02:55.154917 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:02:55.155337 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:02:55.156035 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:02:55.156475 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:02:55.156886 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:02:55.188505 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-9f66c694-bd52-47a9-bcbe-c4ca3dd09793 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.196277 Sep 13 13:02:55.189047 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 13:02:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:02:56.275349 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:02:56.276338 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 13 13:02:56.276728 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 13:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:02:56.467514 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:02:56.470909 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:02:56.471404 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:02:56.471825 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:02:56.472549 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:02:56.472988 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:02:56.473398 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:02:56.493420 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-dc7172ce-19d6-461a-b5ac-204a24bcafbc admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076489 Sep 13 13:02:56.493983 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 13:02:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:03:07.996522 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:03:07.997513 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 13 13:03:07.997976 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 13:03:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:03:08.140828 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_cell0:SELECT=4 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:03:08.141558 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_cell1:SELECT=4 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:03:08.142187 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG dbcounter [-] [106066] Writing DB stats nova_api:SELECT=8 {{(pid=106066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:03:08.192475 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:03:08.196457 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:03:08.196932 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:03:08.197383 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:03:08.198116 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:03:08.198559 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:03:08.198973 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:03:08.224665 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-df8d118e-21b4-4f12-ab77-cad71a605ef4 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.088232 Sep 13 13:03:08.225150 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 13:03:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:03:09.308213 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG nova.api.openstack.wsgi [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] Calling method '>' {{(pid=106067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:03:09.309198 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: INFO nova.api.openstack.requestlog [None req-b66a2efe-c683-40ef-b6b8-f07d759e02da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 13 13:03:09.309584 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: [pid: 106067|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Tue Sep 13 13:03:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:03:09.501756 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG nova.api.openstack.wsgi [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Calling method '>' {{(pid=106066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:03:09.505147 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:03:09.505619 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:03:09.506077 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:03:09.506786 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:03:09.507229 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:03:09.507915 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: DEBUG oslo_concurrency.lockutils [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:03:09.530350 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: INFO nova.api.openstack.requestlog [None req-ff46602c-6319-4aef-b2cf-12c68a3189fd admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.081638 Sep 13 13:03:09.530839 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: [pid: 106066|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Tue Sep 13 13:03:09 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:04:07.776121 dv-cinder-801354-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 13:04:07.776913 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: Tue Sep 13 13:04:07 2022 - graceful shutdown triggered... Sep 13 13:04:07.777338 dv-cinder-801354-10-iscsi devstack@n-api.service[106066]: Gracefully killing worker 1 (pid: 106066)... Sep 13 13:04:07.777687 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: Gracefully killing worker 2 (pid: 106067)... Sep 13 13:04:07.906492 dv-cinder-801354-10-iscsi devstack@n-api.service[106067]: DEBUG dbcounter [-] [106067] Writing DB stats nova_api:SELECT=4 {{(pid=106067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:08.777546 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: worker 1 buried after 1 seconds Sep 13 13:04:08.777546 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: worker 2 buried after 1 seconds Sep 13 13:04:08.777546 dv-cinder-801354-10-iscsi devstack@n-api.service[106065]: goodbye to uWSGI. Sep 13 13:04:08.779080 dv-cinder-801354-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 13:04:08.779648 dv-cinder-801354-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 13:04:08.782524 dv-cinder-801354-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 13:04:08.793695 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 13:04:08 2022] *** Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: nodename: dv-cinder-801354-10-iscsi Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: machine: x86_64 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: clock source: unix Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: pcre jit disabled Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: detected number of CPU cores: 4 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: current working directory: / Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: detected binary path: /usr/bin/uwsgi-core Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: your processes number limit is 47680 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: your memory page size is 4096 bytes Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: detected max file descriptor number: 2048 Sep 13 13:04:08.795767 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: lock engine: pthread robust mutexes Sep 13 13:04:08.796823 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: thunder lock: enabled Sep 13 13:04:08.796823 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 13:04:08.796823 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 13:04:08.836609 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: Python main interpreter initialized at 0x563340ac49c0 Sep 13 13:04:08.836609 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: python threads support enabled Sep 13 13:04:08.836609 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: your server socket listen backlog is limited to 100 connections Sep 13 13:04:08.836609 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: your mercy for graceful operations on workers is 90 seconds Sep 13 13:04:08.837135 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 13:04:08.837135 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: *** Operational MODE: preforking *** Sep 13 13:04:08.837474 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: *** uWSGI is running in multiple interpreter mode *** Sep 13 13:04:08.837474 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: spawned uWSGI master process (pid: 121091) Sep 13 13:04:08.837682 dv-cinder-801354-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 13:04:08.839161 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: spawned uWSGI worker 1 (pid: 121102, cores: 1) Sep 13 13:04:08.839161 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: spawned uWSGI worker 2 (pid: 121103, cores: 1) Sep 13 13:04:08.839161 dv-cinder-801354-10-iscsi devstack@n-api.service[121091]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 13:04:09.503300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 13:04:09.503911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 13:04:10.674488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:04:10.674488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: from cryptography.utils import int_from_bytes Sep 13 13:04:10.675179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:04:10.675179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: from cryptography.utils import int_from_bytes Sep 13 13:04:10.684472 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:04:10.684472 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: from cryptography.utils import int_from_bytes Sep 13 13:04:10.685163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 13:04:10.685163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: from cryptography.utils import int_from_bytes Sep 13 13:04:13.110413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 13:04:13.111120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 13:04:13.111224 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 13:04:13.111589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 13:04:13.111847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 13:04:13.112242 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.112569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.112900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.113221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.113553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.113895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.114225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.114550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.114885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.115149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.115465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.115963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-10-iscsi {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.116292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.116606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.116924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.117250 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.117617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.118028 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.118447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.118966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.119434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.119750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.120066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.120411 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.120730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.121046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.121370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.121682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.122038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.122351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.122765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-10-iscsi {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.123091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.123406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.123722 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.124151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.124459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.124770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.125092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.125417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.125727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.126098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.126403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.126726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.127050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.127355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.127664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.127977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.128296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.128603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.128908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.129161 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.129467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.129812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.130140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.130469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.130721 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.130975 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.131294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.131662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.131927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.132235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.132541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.132847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.133189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.133787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.134261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.134585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.134916 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.135238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.135562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.135874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.136197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.136615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.136871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.137183 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.137528 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.137887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.138201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.138524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.138845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.139224 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.139461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.139864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.140093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.140428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.140736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.140989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.141377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.141600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.142027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.142266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.142572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.142885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.143186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.143494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.143801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.144107 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.144412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.144722 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.145027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.145335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.145666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.145975 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.146280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.146608 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.146936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.147247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.147553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.147862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.148170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.148494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.149325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.149636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.150014 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.150295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.150603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.150927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.151237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.151549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.151868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.152175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.152482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.152804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.153115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.153430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.153758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.154087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.154378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.154685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.155023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.155291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.155590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.155914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.156239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.156551 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.156857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.157163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.157485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.157852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.158188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.158535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.158853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.159186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.159520 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.159841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.160154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.160470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.160800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.161111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.161422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.161768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.162078 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.162399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.162733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.163054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.163378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.163700 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.164013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.164334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.165231 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.165653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.165998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.166346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.166702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.167022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.167353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.167683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.167998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.168332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.168627 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.168986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.169304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.169619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.170044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.170358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.170685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.171004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.171318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.171633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.171947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.172264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.172853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.173170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.173503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.173843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.174159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.174480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.174796 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.175111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.175423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.175732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.176040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.176350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.176728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.176967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.177292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.177624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.177954 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.178287 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.178600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.178915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.179231 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.179545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.179857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.180204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.180600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.180989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.181210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 13:04:13.181662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.181814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 13:04:13.181939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.181939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.182160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 13:04:13.182281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.182391 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 13:04:13.182500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.182619 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 13:04:13.182787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.182972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.183097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.184290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.184468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.184564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.184697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.184793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.184892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.184983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.185075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.185166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.185248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.185338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.185428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.185511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.185599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.185731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.186702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.186882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.187032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.187175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.187268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.187268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.187479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-10-iscsi {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.187606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.187734 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.187938 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.188077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.188164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.188260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.188343 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.188428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.188517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.188647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.188774 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.188871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.188954 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.189043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.189132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.189222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.189310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.189479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.189607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.189803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.189942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.190111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.190258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.190421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.190600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.190747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.190918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.191065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.191273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.191383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.191558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.191665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.191872 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.191968 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.192198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.192296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.192511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.192615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.192914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-10-iscsi {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.193019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.193233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.193343 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.193541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.193666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.193883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.193977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.194211 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.194328 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.194532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.194631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.194847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.194945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.195163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.195261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.195477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.195571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.195944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.196181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.196383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.196484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.196841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.196982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.197248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.197583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.197681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.197919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.198228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.198328 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.198544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.198831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.198935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.199191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.199419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.199518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.199742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.200022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.200133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.200393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.200620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.200726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.201147 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.201663 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.201929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.202040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.202211 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.202366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.202493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.202706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.202798 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.203032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.203123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.203365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.203456 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.203687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.203851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.204008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.204107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.204318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.204459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.204633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.204726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.204945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.205034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.205255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.205346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.205568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.205665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.205909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.206062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.206235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.206367 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.206549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.206679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.206862 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.206999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.207171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.207267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.207489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.207591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.207823 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.207927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.208135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.208222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.208464 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.208552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.208784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.208878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.209111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.209429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.209781 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.209953 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.210098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.210288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.210438 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.210625 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.210793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.210945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.211099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.211973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.212142 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.212294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.212584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.213026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.213194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.213354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.213503 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.213645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.213809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.213970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.214125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.214274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.214415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.214556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.214697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.214844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.214994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.215136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.215311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.215460 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.215634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.215803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.215946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.216086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.216258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.216406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.216560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.216715 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.216864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.217005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.217177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.217333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.217482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.217635 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.217809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.217967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.218116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.218259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.218406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.218556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.218707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.218848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.218997 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.219144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.219296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.219445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.219609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.219767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.219938 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.220094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.220271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.220421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.220578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.220738 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.220887 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.221036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.221186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.221334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.221484 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.221643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.221834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.222170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.222319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.222469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.222611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.222766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.222766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.223043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.223190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.223332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.223481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.223645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.223793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.223945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.224093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.224234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.224383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.224526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.224668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.224808 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.224955 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.225103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.225265 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.225405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.225547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.225762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.225926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.226069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.226219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.226359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.226498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.226673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.226831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.227582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.227755 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.227929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.228078 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.228265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.228434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.228577 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.228725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.228871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.229019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.229241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.229386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.229526 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.229674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.229868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.230013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.230164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.230312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.230471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.230613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.230752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.230907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 13:04:13.231056 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.231197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.231338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.231524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.231673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.231868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.232023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.232455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.232643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.232812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.232974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233414 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.233892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234639 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.234943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235226 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.235960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236699 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.236979 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.237930 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238536 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.238970 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.239986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240699 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.240997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.241917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.242070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.242211 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.242449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.242714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.242874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243735 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.243918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.244967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.245886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246188 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246329 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.246931 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247664 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.247812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.248860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.249906 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250771 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.250912 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251052 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.251965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.252112 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.252277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.252456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.252677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.252929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.253878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.254965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255314 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.255942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256109 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.256937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.257901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.258060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.258418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.258847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259074 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259394 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.259996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.260144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.260440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.260607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.260757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.260904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261218 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261367 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.261862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262021 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.262828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.263943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.264851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265153 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265320 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.265971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266126 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266126 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.266875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267037 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267664 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.267969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.268117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.268277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.268424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.268598 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.268865 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.269870 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.270886 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.271881 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272183 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.272610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.273044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.273309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.273471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.273619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.274296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.274481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.274632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.274779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.274935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275246 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.275999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.276792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.277082 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.277237 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.277386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.277533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.277842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.278906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279364 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.279987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.280136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.280320 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.280495 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.280729 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.280892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.281849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.282945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.283102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.283258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.283523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.283783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.283960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.284883 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285846 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.285998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286454 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.286932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.287998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.288147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.288303 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.288453 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.289119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.289294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.290168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.290340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.290506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.290917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.291981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292456 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.292909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.293682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294473 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.294919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295221 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.295941 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.296872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.297019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.297179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.297334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.297766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.297766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.298983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.299767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.300838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.301116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.301272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.301430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.301578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.301883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302825 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.302974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.303893 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304042 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304454 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.304947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.305944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306720 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.306868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.307032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.307032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.307339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.307515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.307887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.308812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.309901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310237 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310237 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310527 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.310979 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.311236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.311399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.311558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.311723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.311879 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.312113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.312398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.312556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.312705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.312863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313414 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.313922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.314072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.314230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.314230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.314829 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.314997 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.315146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.315330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.315540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.315701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.315868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316025 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.316856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.317013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.317212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.317459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.317773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.317940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318112 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.318874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.319942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.320118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.320267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.320414 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.320568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.321298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.321575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.321769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.321926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.322885 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323033 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.323925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324073 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324221 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324698 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.324956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.325255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.325475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.325632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.325849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326463 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.326930 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327242 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.327990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.328920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329700 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.329884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.330818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331820 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.331981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332278 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.332989 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333598 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.333929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.334839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.335993 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.336140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.340983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.341336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.341522 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.341691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.341984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.342935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343850 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.343999 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.344936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.345095 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.345251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.345527 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.345685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.345874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.346976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347437 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.347890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.348186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.348186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.348487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.348750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.348910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349698 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.349908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350374 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.350830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.351921 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352321 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.352962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.353969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.354899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355525 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.355934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356401 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.356719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357464 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.357943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.358897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359525 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.359845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360703 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.360853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361614 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.361951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362503 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.362981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.363292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.363450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.363615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.363763 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.363924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364073 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.364851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365474 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.365806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.366990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367287 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367641 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367800 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.367958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.368972 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.369967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370743 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.370913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371821 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.371978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.372134 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.372282 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.372532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.372697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.372847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.373974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374289 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374439 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374735 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.374883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375656 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.375960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.376676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.377396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.377553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.377710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.377896 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378759 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.378926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.379876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380188 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.380966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.381934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382391 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.382963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.383640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.383965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.384988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.385146 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.385306 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.385463 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.385620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.385844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386589 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386737 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.386896 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.387971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388451 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.388917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389078 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.389876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.390877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391520 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391839 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.391839 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.392154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.392319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.392479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.392643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.392810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.393208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.394217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.395337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.396475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.397717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.399547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.400725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.401856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.402882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.402882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.402882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.402882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.403543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.403543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.403824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.403989 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.404395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.404704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.405022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.405385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.405699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.406035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.406363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.406674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.406984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.407303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.407620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.407947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.408263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.408577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.408927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.409248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.409820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.410172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.410503 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.410845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.411184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.411500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.411813 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.412127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.412457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.412775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.413093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.413411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.413723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.414076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.414420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.414738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.415056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.415371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.415686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.416001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.416314 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.416629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.417014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.417255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.417601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.417948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.418268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.418586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.418907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.419224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.420165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.420165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.420165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.420621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.420778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.421089 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.421400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.421912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.422247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.422823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.423147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.423468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.423794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.424122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.424435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.424760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.425080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.425416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.425772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.426111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.426442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.426753 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.427166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.427373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.427685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.428008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.428321 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.428631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.428940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.429253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.429558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.430353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.430353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.430696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.430845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.431112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.431420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.431727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.432034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.432342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.432648 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.432985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.433260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.434187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.434187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.434187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.434739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.435117 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.435117 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.435498 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.435765 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.436079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.436407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.436721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.437049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.437375 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.437698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.438035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.438373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.438686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.439001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.439314 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.439628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.439952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.440268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.440587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.440914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.441228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.441560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.441904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.442227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.442547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.442858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.443192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.443506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.443819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.444164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.444445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.444544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO dbcounter [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Registered counter for database nova_api Sep 13 13:04:13.444762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.445079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.445392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.446924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.447271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.447606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.447946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.448283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.448604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.448942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.449280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.449637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.449981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.450333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.450666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.450990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.451307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.451618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 13:04:13.451864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 13:04:13.468062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.475005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.514790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO dbcounter [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Registered counter for database nova_api Sep 13 13:04:13.531559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.context [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f147bbc8-2c91-4f66-bc06-a2f2b3222893(cell1) {{(pid=121102) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 13:04:13.535254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.535887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:04:13.536367 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:04:13.537967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:04:13.538705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:04:13.539155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:04:13.541477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:04:13.542016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.543523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO dbcounter [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Registered counter for database nova_cell0 Sep 13 13:04:13.547940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO dbcounter [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Registered counter for database nova_cell1 Sep 13 13:04:13.555127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.557017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.563116 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.564404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.598626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.context [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f147bbc8-2c91-4f66-bc06-a2f2b3222893(cell1) {{(pid=121103) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 13:04:13.602936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:04:13.603419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:04:13.604969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:04:13.605707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:04:13.606182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:04:13.608252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:04:13.610266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO dbcounter [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Registered counter for database nova_cell0 Sep 13 13:04:13.614312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO dbcounter [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Registered counter for database nova_cell1 Sep 13 13:04:13.621772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.624031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.628992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.631639 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.712349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO dbcounter [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Registered counter for database nova_cell0 Sep 13 13:04:13.719019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_db.sqlalchemy.engines [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.723364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writer thread running {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:13.777832 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO dbcounter [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Registered counter for database nova_cell0 Sep 13 13:04:13.784762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_db.sqlalchemy.engines [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 13:04:13.789116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writer thread running {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 13:04:14.053102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 13:04:14.060936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 13:04:14.109402 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 13:04:14.116754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 13:04:14.411365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 13:04:14.417994 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: WARNING keystonemiddleware.auth_token [None req-e35cc41a-cdc5-41ab-8db3-9773f1f7c8d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 13:04:14.423566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563340ac49c0 pid: 121102 (default app) Sep 13 13:04:14.466770 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 13:04:14.473423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: WARNING keystonemiddleware.auth_token [None req-9e359e54-b9d5-4386-bc70-15aa4a11643f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 13:04:14.479635 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563340ac49c0 pid: 121103 (default app) Sep 13 13:04:52.558538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:52.559379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:52.560519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:52.561429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:53.856535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-211672df-48b2-486c-87cd-6d448177b294 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Action: 'create', calling method: .version_select at 0x7f15660c34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1635647262", "metadata": {"Type": "work"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:04:55.953937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-211672df-48b2-486c-87cd-6d448177b294 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.405253 Sep 13 13:04:55.954962 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1156 bytes} [Tue Sep 13 13:04:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 13:04:56.471633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9021945f-ba2d-4d13-a9b1-adcca236e360 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f156616ef70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:56.510203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:56.511627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:56.513004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:56.513932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:04:56.933979 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9021945f-ba2d-4d13-a9b1-adcca236e360 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 200 len: 353 microversion: 2.1 time: 0.965966 Sep 13 13:04:56.940912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 1/2] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:04:55 2022] GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 353 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:04:57.949329 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-075de0a7-5040-449e-b2f0-7c30a047ec4b tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f1565f923a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:58.048416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-075de0a7-5040-449e-b2f0-7c30a047ec4b tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 200 len: 354 microversion: 2.1 time: 0.103584 Sep 13 13:04:58.049538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:04:57 2022] GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:04:58.065858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca2c370d-4bbd-45ce-82c1-cde3ca560c3c tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f1565f83550>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:58.178310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca2c370d-4bbd-45ce-82c1-cde3ca560c3c tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 200 len: 354 microversion: 2.1 time: 0.118461 Sep 13 13:04:58.179551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:04:58 2022] GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:04:58.198896 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d48bb6ea-f7fc-467e-b572-5de421a7e6e5 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f1565f92a60>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:58.516654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d48bb6ea-f7fc-467e-b572-5de421a7e6e5 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 202 len: 0 microversion: 2.1 time: 0.322703 Sep 13 13:04:58.517825 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 3/5] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:04:58 2022] DELETE /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:04:58.532667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b75b3d0f-9788-4067-ad1b-82994cb73422 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f1565f83a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:58.634360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b75b3d0f-9788-4067-ad1b-82994cb73422 tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 200 len: 353 microversion: 2.1 time: 0.112365 Sep 13 13:04:58.635523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 3/6] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:04:58 2022] GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:04:58.726547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1051643626", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "networks": [{"uuid": "5b976880-9e41-4b86-a566-57238c6963b2"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:04:59.061882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] validate_networks() for [('5b976880-9e41-4b86-a566-57238c6963b2', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:04:59.664432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6d6f039-ed04-4b59-a1ea-bec94d57cb5f tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Calling method '.version_select at 0x7f1565f95160>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:04:59.859227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d6d6f039-ed04-4b59-a1ea-bec94d57cb5f tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] HTTP exception thrown: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6d6f039-ed04-4b59-a1ea-bec94d57cb5f tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Request method failure captured: Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b HTTP/1.1 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIH_0GnaFR1OCkfZcEAnQHWBlNjZAtfobwDfShY59qdnBACKbLf9G7ehTYClFl1ZpCfPJwlU3NFO8PP5BGm6iCtt2QQbhp0GHaGKRKMCn_RGlBthv0mfknm2_O8w96qOfYhCe2CxrySLRqJWB-5ANFNwreu8kwYWsombJqP48WeNa1p4 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 439cc533cdb04e508aeb56243998d880 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesGetTestJSON-818493770 Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:04:59.865711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/439cc533cdb04e508aeb56243998d880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/439cc533cdb04e508aeb56243998d880"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_439cc533cdb04e508aeb56243998d880", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/439cc533cdb04e508aeb56243998d880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesGetTestJSON-818493770 Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 439cc533cdb04e508aeb56243998d880 Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesGetTestJSON-818493770 Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesGetTestJSON-818493770-project Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: f76a56d0dbeb43d1b0e2d87b1a27544c Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesGetTestJSON-818493770-project Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'b06b724d-6550-4fd6-93b0-1b93254fee2b'} Sep 13 13:04:59.868292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. (HTTP 404) (Request-ID: req-83de7eed-0972-4ec1-9c65-ad1a953fc88b) Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:04:59.869121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:04:59.870325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 13:04:59.872845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. Sep 13 13:04:59.879703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:04:59.899652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6d6f039-ed04-4b59-a1ea-bec94d57cb5f tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] Returning 404 to user: Volume b06b724d-6550-4fd6-93b0-1b93254fee2b could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:04:59.900559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6d6f039-ed04-4b59-a1ea-bec94d57cb5f tempest-VolumesGetTestJSON-818493770 tempest-VolumesGetTestJSON-818493770-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b" status: 404 len: 109 microversion: 2.1 time: 0.242616 Sep 13 13:04:59.908483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:04:59 2022] GET /compute/v2.1/os-volumes/b06b724d-6550-4fd6-93b0-1b93254fee2b => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:05:00.795442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:00.795953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:00.796829 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:00.797267 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:00.798229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:00.840753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:00.841162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:00.841792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:00.842885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:00.843905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:00.844636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:00.890438 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Getting quotas for project eaaf8aa87a0f47cc9ba9f477de3c2d67. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:00.904517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Getting quotas for user e54f17d6995f4c099708d79715d95220 and project eaaf8aa87a0f47cc9ba9f477de3c2d67. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:00.926975 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:00.937633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:01.289861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c00d73d8-42a7-4609-8152-bced06191550 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676332 Sep 13 13:05:01.294314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 4/8] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:05:01.308181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19a76eb5-6ee4-457c-bfbf-20619d05e9e8 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:01.309893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19a76eb5-6ee4-457c-bfbf-20619d05e9e8 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:02.153686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-19a76eb5-6ee4-457c-bfbf-20619d05e9e8 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:02.220920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19a76eb5-6ee4-457c-bfbf-20619d05e9e8 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1215 microversion: 2.1 time: 0.918028 Sep 13 13:05:02.225019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 5/9] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:01 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1215 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:03.255108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc9c47c4-62f7-41de-94a5-6fed2c87e2d9 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:03.255751 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc9c47c4-62f7-41de-94a5-6fed2c87e2d9 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:03.674579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc9c47c4-62f7-41de-94a5-6fed2c87e2d9 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:03.700507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc9c47c4-62f7-41de-94a5-6fed2c87e2d9 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1215 microversion: 2.1 time: 0.455794 Sep 13 13:05:03.703559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 5/10] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:03 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1215 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:04.729473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:04.733112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:04.750193 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:04.750742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:04.754369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:04.755163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:04.758121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:04.760868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:05.244591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:05.268492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57ef7531-8fe1-4c9d-b886-041d8445e4d4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1219 microversion: 2.1 time: 0.543828 Sep 13 13:05:05.273707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 6/11] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:04 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1219 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:05.706951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6405d91-ab09-4514-b650-37b5a0fa468f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: .version_select at 0x7f15656519d0>, body: {"keypair": {"name": "tempest-keypair-782145439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcXp1CjvZJetHau3+mPPz4t0wAU3N8Wa9YSSPO+aX0KZQvsP4V2G7Rk1pa6REUnBXVnSn0Zh5QtU2ExNrG0U0e0WXwFz5qZ6Gi7AjtzBazxDsprxUIb9HwPnyyRL9hamw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:05.768938 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-a6405d91-ab09-4514-b650-37b5a0fa468f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:05.783553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-a6405d91-ab09-4514-b650-37b5a0fa468f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:05.953866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6405d91-ab09-4514-b650-37b5a0fa468f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.772772 Sep 13 13:05:05.964533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 6/12] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:05:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:06.295374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:06.296891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:06.304812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:06.315669 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:06.320143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:06.320954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:06.321451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:06.321932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:06.497958 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:06.509521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-24b9406f-8497-462e-b562-234e1cc88a8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1267 microversion: 2.1 time: 0.217815 Sep 13 13:05:06.513384 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:06 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:07.537293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:07.538670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:07.565525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:07.572674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:07.573350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:07.575832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:07.578260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:07.581407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:08.615572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:08.649450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9bf32145-c9aa-4338-9723-e59f4d2f6d8e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1273 microversion: 2.1 time: 1.109664 Sep 13 13:05:08.661765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 7/14] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:07 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1273 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:09.686437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:09.688502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:09.708022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:09.710323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:09.710807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:09.719175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:09.719859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:09.720324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:10.501675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:10.527492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2685243-9beb-45d6-bdd4-c81c6cf5402c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1273 microversion: 2.1 time: 0.836853 Sep 13 13:05:10.532044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 8/15] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:09 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1273 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:11.562770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:11.563459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:11.565598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:11.574729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:11.581040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:11.581723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:11.582691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:11.583301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:11.595993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:11.920868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:11.935468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8010e9c6-f01b-4afb-ab46-62c8f1492e07 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1273 microversion: 2.1 time: 0.376989 Sep 13 13:05:11.961454 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 8/16] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:11 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:12.969239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:12.969239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:12.969239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:12.980403 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:12.986956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:12.991304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:12.991304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:12.991304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:12.991304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:13.751131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:13.762079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-093c2dc7-157a-4595-9bf3-bc780c628b1d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.805348 Sep 13 13:05:13.773989 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 9/17] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:12 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:14.335675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c15f5def-20e2-4b9f-8ad4-c5b7bd25550b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: .version_select at 0x7f1565547670>, body: {"keypair": {"name": "tempest-keypair-1014748545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO6mv36nZz57kq6WBminwNwnO6PctE+ZFmKL+B4LvlmFbVuMKwnnW+1taN826Lz5Vy4FES36KeiulrJIgeLxWiViw3VOiyHPlEbNs8RuXsdE5FkuUVoTLwjFSNG9/bKaw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:14.406868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c15f5def-20e2-4b9f-8ad4-c5b7bd25550b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:14.418815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c15f5def-20e2-4b9f-8ad4-c5b7bd25550b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for user fe3be97820d64f85aa4d2dbd8f3ffd33 and project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:14.623409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c15f5def-20e2-4b9f-8ad4-c5b7bd25550b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.613290 Sep 13 13:05:14.626358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 9/18] 10.222.0.72 () {62 vars in 1200 bytes} [Tue Sep 13 13:05:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 616 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 13:05:14.795850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:14.798162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:14.810492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:14.811329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:14.812063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:14.813031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:14.815096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:14.815694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:15.110524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1512090970", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f0b8231-ada5-4945-87a4-d1b052328819"}], "security_groups": [{"name": "tempest-securitygroup--1209359042"}], "key_name": "tempest-keypair-782145439", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:15.609430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] validate_networks() for [('1f0b8231-ada5-4945-87a4-d1b052328819', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:05:16.940584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:16.943127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a5bdfbb5-7069-4fe2-a946-28d782e0425a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 2.151437 Sep 13 13:05:16.958411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 10/19] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:14 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:17.380727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:17.382063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:17.383133 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:17.383838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:17.384529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:17.398109 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:17.398933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:17.399599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:17.400615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:17.401276 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:17.402628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:17.439773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:17.447882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:17.466748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:17.471872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:17.711446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5fbc2b3-48ca-4d7b-9965-e6c1b2ca2c1a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.617912 Sep 13 13:05:17.712990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 10/20] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:05:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:05:17.723943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e0c0dfe9-e6a2-4cc1-b78c-0f31ba7acad4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:17.725508 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e0c0dfe9-e6a2-4cc1-b78c-0f31ba7acad4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:17.973382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:17.974338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:17.984210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:17.997619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:18.003910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:18.004926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:18.006570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:18.007283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:18.330626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e0c0dfe9-e6a2-4cc1-b78c-0f31ba7acad4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:18.352789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e0c0dfe9-e6a2-4cc1-b78c-0f31ba7acad4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1241 microversion: 2.1 time: 0.623756 Sep 13 13:05:18.356161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 11/21] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:17 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1241 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:18.797389 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:18.819775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b941525d-c278-4db8-9a03-456f0b20f143 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.850372 Sep 13 13:05:18.823493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 11/22] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:17 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:19.187415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-594835371", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b1eaf98-b39c-4204-9cb2-5b574f83717c"}], "security_groups": [{"name": "tempest-securitygroup--1522886360"}], "key_name": "tempest-keypair-1014748545", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:19.395339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c9247420-35c0-40bf-abc1-7233dca5f3a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:19.395969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c9247420-35c0-40bf-abc1-7233dca5f3a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:19.919499 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c9247420-35c0-40bf-abc1-7233dca5f3a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:19.931147 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c9247420-35c0-40bf-abc1-7233dca5f3a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1241 microversion: 2.1 time: 0.552020 Sep 13 13:05:19.934106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 12/23] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:19 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1241 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:19.951687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:19.954602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:20.000683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] validate_networks() for [('8b1eaf98-b39c-4204-9cb2-5b574f83717c', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:05:20.010005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:20.012108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:20.014406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:20.019058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:20.020077 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:20.021486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:21.983406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:21.994349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c532da4-d721-45a9-93d1-a148739e381a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 2.058009 Sep 13 13:05:22.007060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 13/24] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:19 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:22.081601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee33adeb-995f-4c4c-8949-9ca85008efe1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: .version_select at 0x7f15654f0b80>, body: {"keypair": {"name": "tempest-keypair-905609902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlXvcbhm0okPJCd+LmFnVf08JBEPRdOHoPql7eK/zg3hOGXIraM8UxqAjkCPshXsydE4XLZH2gFVGr/70JdCslcD3B/VvNT3tyGV5lRNLPbvTuh4GV7V9SSs9vfyh+y3A=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:22.128822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-ee33adeb-995f-4c4c-8949-9ca85008efe1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for project 75f6274158934ab5abf68951902f1e81. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:22.141100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-ee33adeb-995f-4c4c-8949-9ca85008efe1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for user 7b1c15ff53e5442881b56bf504b9a31b and project 75f6274158934ab5abf68951902f1e81. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:22.277085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee33adeb-995f-4c4c-8949-9ca85008efe1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.266986 Sep 13 13:05:22.280227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:22.280716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:22.281372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:22.281987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:22.282603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:22.285638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 14/25] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:05:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:22.300610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:22.306145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:22.317209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.317724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.318195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.319967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.320423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.320847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.344765 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.345274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.348469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.350161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.350966 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.351860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.412028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:22.419303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for user fe3be97820d64f85aa4d2dbd8f3ffd33 and project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:22.433724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:22.445917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:22.481966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:22.498626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74afb71b-0167-45cb-ae36-9b5f4ad8eaab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1237 microversion: 2.1 time: 0.207092 Sep 13 13:05:22.499292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 15/26] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:22 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:22.655897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-292aabb4-02af-4b80-b953-e751a89384b3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.477712 Sep 13 13:05:22.662954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 12/27] 10.222.0.72 () {62 vars in 1188 bytes} [Tue Sep 13 13:05:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 3485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 13:05:22.710450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860a38df-4d3d-47b0-ba9f-f42a3f7a04ca", "tag": "f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:22.732018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.736364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.736970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.745847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1180153841", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:22.792229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Creating event network-changed:f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4 for instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca on hv-cinder-80135 Sep 13 13:05:22.793049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 13:05:22.793635 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-7069a1ed-6471-4836-874d-f5aa4d8bf735 req-3ce63078-73ed-4466-bab5-09a9e5d18e74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 13:05:22.794888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.795546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.796474 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.797911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:22.798574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:22.799112 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:22.825858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.compute.rpcapi [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 13:05:22.828604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] Releasing lock "compute-rpcapi-router" {{(pid=121102) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 13:05:22.846559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] validate_networks() for [('d2a92aa9-ba65-41c7-9fbf-76e49b2ae7c7', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:05:22.860330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a42bc608-115b-4850-a722-47bb4f08379c None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359777 Sep 13 13:05:22.861580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 16/28] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:22.869076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:22.870878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:22.999649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:23.004270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=29 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:23.010321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:23.011911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:23.013298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-33e6e381-ab41-4eb1-a949-3b07b42ac4f3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1281 microversion: 2.20 time: 0.150335 Sep 13 13:05:23.014346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 17/29] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:22 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:23.019842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:23.020696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:23.028657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:23.030654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.031214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.031810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.032717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.034187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.034982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.038962 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=39 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:23.441620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:23.451319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-429c7529-54bf-4afe-8331-b38a204ce85b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.435687 Sep 13 13:05:23.452613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 18/30] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:23 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:23.526471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:23.527020 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:23.544892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.545051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.545662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.546825 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.547459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.548097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.696540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:23.721430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53a3c3e7-f1ef-49ef-bcfd-bd8e521e74a9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1237 microversion: 2.1 time: 0.199528 Sep 13 13:05:23.737683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 19/31] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:23 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1237 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:23.753027 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:23.767584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:23.767584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:23.767584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:23.767584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:23.778251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.779359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.780320 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.788009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:23.789003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:23.794642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:23.832799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:23.843700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for user 8c688fff323943b3bbcbb0569d974d0a and project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:23.869547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:23.873329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:24.058161 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:24.059621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:24.090051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.101043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.104258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.126763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0e1af8fe-4bf8-422a-b850-aa62a1a5f558 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.461382 Sep 13 13:05:24.136083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 13/32] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:05:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:05:24.136694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.137167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.137628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.182576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ead2ff5-f9b4-4419-bc0e-41e2a988843f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:24.183844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ead2ff5-f9b4-4419-bc0e-41e2a988843f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:24.339729 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ead2ff5-f9b4-4419-bc0e-41e2a988843f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.362365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ead2ff5-f9b4-4419-bc0e-41e2a988843f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1222 microversion: 2.1 time: 0.213727 Sep 13 13:05:24.363048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 14/33] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:24 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:24.388032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.406255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.408507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.410202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c850e70b-ff2c-4120-a145-08bba0042058 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1285 microversion: 2.20 time: 0.374583 Sep 13 13:05:24.462657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 20/34] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:24 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1285 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:24.474957 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:24.475784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:24.489657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.494537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.494988 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.495742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.496214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.496649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.589018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-699952675", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:24.655168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] validate_networks() for [('d2a92aa9-ba65-41c7-9fbf-76e49b2ae7c7', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:05:24.681165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.691444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b6af3ac-4368-4c02-9763-5c8861acc55a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.220213 Sep 13 13:05:24.692695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 15/35] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:24 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:24.754809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:24.758201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:24.766462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.776016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.777016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.781634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:24.784392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:24.784845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:24.889574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:24.898227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc964755-ec87-42b9-afa4-ec922b34b8e3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1293 microversion: 2.1 time: 0.150807 Sep 13 13:05:24.899342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 16/36] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:24 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:25.184860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:25.185406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:25.185860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:25.186170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:25.186583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:25.203545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.204893 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.206111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.208764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.210070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.216575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.246804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:25.267533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for user 8c688fff323943b3bbcbb0569d974d0a and project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:25.296059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:25.298483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:25.458688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:25.459490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:25.468080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.469436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.470201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.471014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.471580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.472106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.536180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97b60930-cb42-41ac-acd8-1c50a9acceb9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.951588 Sep 13 13:05:25.544594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 21/37] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:05:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:05:25.565647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-63cddbe9-5304-4519-af40-a04a4a046b44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:25.571542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-63cddbe9-5304-4519-af40-a04a4a046b44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:25.617121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:25.627896 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:25.629489 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:25.646161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b46975fe-8ff1-49b7-b30b-586a263a1f71 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1285 microversion: 2.20 time: 0.191734 Sep 13 13:05:25.653827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 17/38] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:25 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:25.683762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-63cddbe9-5304-4519-af40-a04a4a046b44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:25.694400 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-63cddbe9-5304-4519-af40-a04a4a046b44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1221 microversion: 2.1 time: 0.141674 Sep 13 13:05:25.717939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 22/39] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:25 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:25.726460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:25.733964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:25.785952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.788645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.790310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.792200 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.799276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.800061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.930729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:25.931537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:25.963006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.963625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.965683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:25.972064 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:25.972564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:25.972998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:26.346053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.361648 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fd48c47d-23b1-4689-9541-185dcc07397a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.645010 Sep 13 13:05:26.363299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 18/40] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:25 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:26.367047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.405366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53d0ab76-3dda-4096-8126-28a5ed341e87 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1293 microversion: 2.1 time: 0.481928 Sep 13 13:05:26.407919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 23/41] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:25 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:26.439956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1207907998", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6ee3a0-91e5-4300-8f53-c3332833b2a0"}], "security_groups": [{"name": "tempest-securitygroup--1253238052"}], "key_name": "tempest-keypair-905609902", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:26.598409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] validate_networks() for [('9a6ee3a0-91e5-4300-8f53-c3332833b2a0', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:05:26.672671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:26.673286 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:26.684079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:26.684638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:26.689521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:26.689521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:26.689521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:26.689521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:26.796552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.812581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.814565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.815845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d1e7538-a52c-4fd6-a241-737266ce8f84 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1285 microversion: 2.20 time: 0.147310 Sep 13 13:05:26.816550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 24/42] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:26 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:05:26.825956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f40cacda-f29b-4970-a687-cf5674f82798 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:26.826575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f40cacda-f29b-4970-a687-cf5674f82798 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:26.973549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f40cacda-f29b-4970-a687-cf5674f82798 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:26.986514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f40cacda-f29b-4970-a687-cf5674f82798 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1221 microversion: 2.1 time: 0.168651 Sep 13 13:05:26.995570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 25/43] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:26 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:27.390730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:27.391504 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:27.408246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:27.408754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:27.413308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:27.414195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:27.414686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:27.415129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:27.938456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:27.947219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b2bd737-569e-433a-b383-c2ed66e9f994 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.560108 Sep 13 13:05:27.954497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 26/44] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:27 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:27.960932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:05:27.961455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:05:27.961884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:05:27.962481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:05:27.963048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:05:27.972963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:27.973236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:27.979935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:27.980652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:27.982600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:27.983530 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:27.985147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:27.986347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:27.987639 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.000999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.001452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.007760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.010402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.011035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.065727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for project 75f6274158934ab5abf68951902f1e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:05:28.077325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for user 7b1c15ff53e5442881b56bf504b9a31b and project 75f6274158934ab5abf68951902f1e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:05:28.090574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:05:28.093039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:05:28.115423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:28.256314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:28.270094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09270ce6-f53d-44d1-99b2-a0d4277a01fd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1293 microversion: 2.1 time: 0.320737 Sep 13 13:05:28.272734 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 27/45] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:27 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1293 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:28.304129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:28.307574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:28.341926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.342539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.343072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.343956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.344542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.345009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.355445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb237905-3196-4d09-8e9f-b2eaef92e081 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.918826 Sep 13 13:05:28.358613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 19/46] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:05:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:05:28.378298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:28.385849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:28.399830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.402015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.408646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.408646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:28.409296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:28.410054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:28.423053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=61 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:28.978923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.000752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.030271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4f42acd1-241c-4164-b3e6-1993dccec902 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1217 microversion: 2.1 time: 0.663119 Sep 13 13:05:29.034968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 20/47] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:28 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1217 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:29.046004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81bdc0c7-adde-480a-b408-6aefb1019360 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:29.048471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.050890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.052225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6aea3bc3-52f1-4b6f-bb4e-b1c5b026e45d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1333 microversion: 2.20 time: 0.778203 Sep 13 13:05:29.052356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81bdc0c7-adde-480a-b408-6aefb1019360 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:29.058796 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 28/48] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:28 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1333 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:29.063690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:29.074833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:29.088153 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:29.095691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:29.095691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:29.095691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:29.095691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:29.095976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:29.137633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-81bdc0c7-adde-480a-b408-6aefb1019360 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.163853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81bdc0c7-adde-480a-b408-6aefb1019360 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1237 microversion: 2.1 time: 0.126011 Sep 13 13:05:29.168139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 21/49] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:29 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:29.298372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:29.307511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:29.315334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:29.335935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:29.335935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:29.335935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:29.335935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:29.336672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:29.373911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.382796 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ba59586-f776-4260-8c9c-4c3855e90ade tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.322708 Sep 13 13:05:29.383379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 29/50] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:29 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:29.409762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:29.421566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd69ae79-88a3-4071-be96-6a523ed14e0a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1299 microversion: 2.1 time: 0.126640 Sep 13 13:05:29.432209 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 22/51] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:29 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:30.054972 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:30.055699 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:30.061632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.062163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.062603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.063298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.063748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.064323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.091425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:30.093458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:30.108172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.108674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.109169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.109869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.110433 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.110818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.203297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.216934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e210301-570f-445d-9f0e-88fee6d9a78d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1273 microversion: 2.1 time: 0.164233 Sep 13 13:05:30.222047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 30/52] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:30 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:30.231228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-871d7375-2e94-4864-be7e-db1e3aaa0e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:30.232553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-871d7375-2e94-4864-be7e-db1e3aaa0e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:30.352361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.376515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.381609 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-871d7375-2e94-4864-be7e-db1e3aaa0e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.381955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.381955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-69bd71f8-3777-48b5-84ac-31cd5537f60f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1341 microversion: 2.20 time: 0.294704 Sep 13 13:05:30.385692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-871d7375-2e94-4864-be7e-db1e3aaa0e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1237 microversion: 2.1 time: 0.165145 Sep 13 13:05:30.393980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 23/53] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:30 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1341 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:30.394166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 31/54] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:30 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:30.423233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:30.423841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:30.430447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.430929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.431360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.432053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.432666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.433270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.494051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:30.494051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:30.507815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.508328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.508777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.509491 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:30.510011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:30.513853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:30.605998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.617319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c93a8e24-0d53-46e6-bd72-39f74e5c995c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1299 microversion: 2.1 time: 0.133348 Sep 13 13:05:30.618320 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 32/55] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:30 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:30.625167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:30.634493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91af0019-a88f-477e-8233-08de261db231 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.215179 Sep 13 13:05:30.635366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 24/56] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:30 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:31.242797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:31.243403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:31.249319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.249844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.250291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.250970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.251415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.251944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.314913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.322974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52db2dd5-29e4-451c-a8a4-31f4796ff797 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1273 microversion: 2.1 time: 0.084675 Sep 13 13:05:31.323539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 33/57] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:31 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:31.407496 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:31.408678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:31.410275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:31.411106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:31.415255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.415756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.416224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.417003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.417286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.417485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.417776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.417984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.418201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.418677 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.419135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.419588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.489019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.496711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1e15fe87-3e75-4e43-8eb7-f8099d4995dc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1241 microversion: 2.1 time: 0.090161 Sep 13 13:05:31.497266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 34/58] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:31 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:31.504582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.514371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.518033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.518033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6bf8ca8e-2867-4630-8189-ae5004e76a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1341 microversion: 2.20 time: 0.114086 Sep 13 13:05:31.518317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 25/59] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:31 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:31.640410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:31.641032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:31.647810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.648485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.648916 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.649611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.650163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.650629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.659547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:31.660425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:31.668817 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.669324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.669773 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.670901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:31.672197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:31.672790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:31.874218 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.882945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-389f08db-ce01-4e57-96bb-2dfe3a28a318 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.246284 Sep 13 13:05:31.883729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 35/60] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:31 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:31.890288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:31.898536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1ef41b5c-4746-485c-83d2-b96d6cc0253c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.244201 Sep 13 13:05:31.899104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 26/61] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:31 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:32.346207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:32.346810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:32.353272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.353761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.354216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.354896 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.355342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.355758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.417107 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:32.425223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4c34bf1-6b8e-403c-ae55-b492247c7177 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1273 microversion: 2.1 time: 0.082824 Sep 13 13:05:32.425862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 36/62] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:32 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:32.518965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:32.519571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:32.526084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.526567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.526998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.527675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.528127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.528545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.542986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:32.543640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:32.549712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.550159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.550591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.551311 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.551763 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.552178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.595500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:32.604093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-414654e7-e6c4-479d-bd4c-e62d4c0324b1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1241 microversion: 2.1 time: 0.088915 Sep 13 13:05:32.604871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 27/63] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:32 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:32.623370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:32.630664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:32.632115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:32.633221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c1bf5f71-8f7a-4b18-a00b-619127c7c1f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1341 microversion: 2.20 time: 0.094173 Sep 13 13:05:32.634023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 37/64] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:32 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:05:32.906280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:32.906890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:32.912840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.913428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.913904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.914585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.915122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.915553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.920166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:32.921105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:32.927054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.927615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.928057 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.928785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:32.929269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:32.929691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:32.945013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:33.107890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.116130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af987510-e5aa-4e7c-9277-ee7fa9a06a39 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.213485 Sep 13 13:05:33.116926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 28/65] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:32 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:33.122076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.129676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2d878d58-469a-44ec-9200-dfd2d7c61ccf tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.213266 Sep 13 13:05:33.130477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 38/66] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:32 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:33.448527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:33.449150 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:33.455150 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.455646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.456085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.456787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.457243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.457671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.526973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.534786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b47a5cad-2ed5-4e0d-843e-f807ffe4f21a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1273 microversion: 2.1 time: 0.090204 Sep 13 13:05:33.538799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 29/67] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:33 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:33.626661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:33.627189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:33.634071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.634567 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.635008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.635707 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.636247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.636674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.658893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:33.659531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:33.666036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.666528 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.667158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.667851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:33.668309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:33.668735 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:33.698683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.706576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1e9781f-a40b-423f-99e2-b21ccc5f1790 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1241 microversion: 2.1 time: 0.083847 Sep 13 13:05:33.707150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 39/68] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:33 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:33.730003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.738249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.739721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:33.740861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ee2f19e-ef23-497f-8835-175b18654656 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1341 microversion: 2.20 time: 0.085927 Sep 13 13:05:33.741446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 30/69] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:33 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:05:34.138680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:34.139313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:34.145347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.145810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.146254 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.146985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.147552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.147979 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.154414 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:34.155023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:34.165247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.165771 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.166217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.166929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.167389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.167820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.573180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.583517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b18dd9f8-47fa-47a4-b7c4-8c1c2b49e27b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.433550 Sep 13 13:05:34.594061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.601009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 31/70] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:34 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:34.608943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:34.610523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:34.611842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa466d7b-6fcf-4fa8-8662-2e8290f50780 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.475784 Sep 13 13:05:34.612449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 40/71] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:34 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:34.620419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.621861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.622533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.623505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.624760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.625409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.719766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.730686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-101a9e2e-4785-4137-9708-1f080ef68ea1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1273 microversion: 2.1 time: 0.125232 Sep 13 13:05:34.731524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 32/72] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:34 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:34.732511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:34.733214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:34.739352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.739838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.740525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.741360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.741837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.742270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.767856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:34.769142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:34.776759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.777257 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.777701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.778451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:34.778908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:34.779330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:34.816540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.836853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a58596c-e0d1-44fb-b310-ce01e102a2f5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1241 microversion: 2.1 time: 0.109493 Sep 13 13:05:34.837449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 41/73] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:34 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:34.926764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.947766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.956166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:34.956166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a89c0644-81a3-47b5-a850-ba2ebec38d10 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1351 microversion: 2.20 time: 0.189414 Sep 13 13:05:34.956166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 33/74] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:34 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1351 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:05:35.611991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:35.612648 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:35.617160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:35.620334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:35.620875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:35.621315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:35.622157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:35.622617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:35.623074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:35.642320 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:35.644280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:35.662059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:35.665659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:35.666952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:35.669197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:35.671681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:35.673020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:35.999351 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.007593 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-06818797-b84c-4429-b276-607b7103d850 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.373089 Sep 13 13:05:36.009823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 34/75] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:35 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:36.021914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:36.028936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:36.032463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.042351 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.042832 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.043279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.044517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.044920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.045350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.050827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0348ccd6-c277-430f-88e3-572464f18660 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.442544 Sep 13 13:05:36.051446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 42/76] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:35 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:36.057040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:36.062470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:36.066711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.067207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.067678 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.079164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.079659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.080098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.247769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.249661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.265888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee579efe-a16e-4130-8b73-1621d3ec410b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1233 microversion: 2.1 time: 0.213315 Sep 13 13:05:36.279078 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8157773f-6620-41cd-a827-fff6330f9035 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1281 microversion: 2.1 time: 0.264213 Sep 13 13:05:36.283274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 43/77] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:36 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1233 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:36.290673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 35/78] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:36 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:36.298283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:36.299112 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:36.314113 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.314745 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.316484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.317285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.322607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.323203 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.404630 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.417517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.422010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:36.422010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fa94856b-cdfb-423c-8a8e-05fd52e6e352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1339 microversion: 2.20 time: 0.134917 Sep 13 13:05:36.422010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 44/79] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:36 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:36.749692 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42476fd8-5bc5-47f9-8aa9-da3e3012656b", "tag": "c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:36.775976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.776467 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.780274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.845166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Creating event network-changed:c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c for instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b on hv-cinder-80135 Sep 13 13:05:36.848507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 13:05:36.852977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8fee2ab5-c5df-45d9-a503-4b76ba22103e req-d0a6740b-4da4-4791-87a2-b4e98bb3386b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 13:05:36.855342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.856088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.856667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.857537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.860009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.862237 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.873956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860a38df-4d3d-47b0-ba9f-f42a3f7a04ca", "name": "network-vif-plugged", "status": "completed", "tag": "f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:36.905985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:36.907518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:36.909544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:36.917089 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.compute.rpcapi [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 13:05:36.919859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] Releasing lock "compute-rpcapi-router" {{(pid=121103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 13:05:36.942582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] Creating event network-vif-plugged:f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4 for instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca on hv-cinder-80135 Sep 13 13:05:36.957501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de3c181c-ad6d-4950-87fe-8842146b0568 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303005 Sep 13 13:05:36.958226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 36/80] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:36.962091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-bcadaad5-dc73-4b5e-971f-c86f074495ec req-25b960ff-7c81-458e-9dd8-f8eb9cc6d6dc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207122 Sep 13 13:05:36.963318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 45/81] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:05:37.035483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:37.037248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:37.065190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.067558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.068186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.069239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.069901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.070755 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.084103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:37.084103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:37.094667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.095827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.096960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.099482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.112638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.112638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.735620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:37.744112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1a00158-ac29-49d6-aef4-0ac06d7efa83 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.715147 Sep 13 13:05:37.754142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 37/82] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:37 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:37.771475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:37.788752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-74e0a9e0-98df-4944-8ae4-846a6890cfc4 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.712678 Sep 13 13:05:37.789976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:37.790831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:37.803114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 46/83] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:37 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:37.818625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:37.820495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.821623 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:37.822312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.822893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.825484 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.826163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.828215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.835838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.837436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:37.838827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.840044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.841004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:37.843001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:37.844862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:37.978619 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:37.989688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c89ebd04-f016-4ec4-b0c3-8897f4a98097 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1289 microversion: 2.1 time: 0.233798 Sep 13 13:05:38.002576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 38/84] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:37 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1289 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:38.012206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:38.013068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:38.020345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.020987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.021568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:38.023093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.023780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.024450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:38.276684 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:38.311934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8ba1554-771a-4700-8376-f28ccebe7ccd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.501200 Sep 13 13:05:38.312852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 47/85] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:37 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:38.678499 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:38.686814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:38.688291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:38.689439 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a86408da-41ff-4865-a8df-4ae46b031fa6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.685263 Sep 13 13:05:38.690044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 39/86] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:38 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:38.770131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:38.770738 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:38.776968 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.777446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.777904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:38.778594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.779801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.779801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:38.816572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:38.817194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:38.823706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.824217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.824649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:38.825344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:38.825814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:38.826271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.074961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.082926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1034ffc-f1d9-490e-b718-7b3278fa8340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.316621 Sep 13 13:05:39.083498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 48/87] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:38 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:39.090035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:39.098166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.100347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.100895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.101329 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.108457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4d72072-a3e7-4093-889b-8f32c9e5de4b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.295534 Sep 13 13:05:39.109612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 40/88] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:38 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:39.114433 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:39.115159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:39.120391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] Creating event network-changed:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:05:39.125181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.125965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.127527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.128178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d0ca1186-fc42-4b06-b138-e8ea75d8e57f req-edc931fb-a547-4ec5-813c-669912b5e16c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043526 Sep 13 13:05:39.128690 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.128838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 49/89] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:39.129685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.130214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.151582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=24 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:39.203873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.213900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e12530ea-5b05-4977-b9f2-3f742af63dcf tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1307 microversion: 2.1 time: 0.102031 Sep 13 13:05:39.213900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 41/90] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:39 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:39.341714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:39.343668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:39.353565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.355675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.355675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.356687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.357437 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.358132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.674232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.687412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c2ff6b43-d272-4b1f-b025-568325e20b9d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.352646 Sep 13 13:05:39.698237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 50/91] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:39 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:39.716634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:39.718172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:39.724620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.725642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.726131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.726922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.727381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.727805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.842167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e11dc092-73fb-4122-9cea-7a41398c3c66", "tag": "9537de83-a92f-4647-a5d6-285071c8be74"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:39.852119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:39.852865 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:39.853478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:39.865289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] Creating event network-changed:9537de83-a92f-4647-a5d6-285071c8be74 for instance e11dc092-73fb-4122-9cea-7a41398c3c66 on hv-cinder-80135 Sep 13 13:05:39.872086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-740d8c7d-01f8-458c-9859-984629494922 req-ae36e45b-2c5b-4057-9950-1b5450ca259b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033034 Sep 13 13:05:39.873065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 51/92] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:05:39.958037 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.963136 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.964671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:39.966185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-932a1da3-806b-4830-a37b-0b841912bcc5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.254700 Sep 13 13:05:39.992000 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 42/93] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:39 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:40.108488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:40.109209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:40.116165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.116658 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.117145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.117903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.120614 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.120614 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.135107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:40.135718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:40.142684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.143172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.143608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.144294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.144770 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.146511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.371456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:40.380419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=13 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:40.383129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62f59feb-db6b-48ba-8a03-c0be271405e4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.279163 Sep 13 13:05:40.386735 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:40.391351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 52/94] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:40 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:40.401242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cc1a52f-8738-4cb1-be47-9fde2698242b tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.269333 Sep 13 13:05:40.411913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 43/95] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:40 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:40.412125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:40.412125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:40.412125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.412125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.413672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.414688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.415235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.415676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.477969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:40.485552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a54a50ce-01c5-4283-8c0a-842261dcda80 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1307 microversion: 2.1 time: 0.090304 Sep 13 13:05:40.486141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 53/96] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:40 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:40.711565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:40.712167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:40.718315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.718802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.719233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.719911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:40.720359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:40.720776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:40.854888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:40.867133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b38820e7-f68e-4011-a8d8-f1a35b1aab58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.159837 Sep 13 13:05:40.867721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 44/97] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:40 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:40.997844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:41.007953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:41.007953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.007953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.007953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.008413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.008413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.008413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.145937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.155080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.158934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.160064 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d8a0dd1f-6db6-4ef4-9388-9298d825cd66 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.167453 Sep 13 13:05:41.160623 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 54/98] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:40 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:41.413656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:41.414467 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:41.421162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.421714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.422170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.429577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.429577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.429577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.429996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:41.429996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:41.433326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.433856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.434302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.434984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.435594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.436327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.626980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.633937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.642087 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ab81b6b3-a136-41f4-b95f-ac6c1a5a0d8a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.232217 Sep 13 13:05:41.644976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 45/99] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:41 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:41.658122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce65d0c7-0bd7-4a6d-af01-9dd82a8e4892 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.228520 Sep 13 13:05:41.658122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 55/100] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:41 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:41.658122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:41.658122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:41.667253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.667875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.668377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.669265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.669824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.670351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.732795 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:41.740984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ab24071-019a-4f87-b222-f9587458aa8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1307 microversion: 2.1 time: 0.088442 Sep 13 13:05:41.741548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 56/101] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:41 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:41.890716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:41.891406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:41.898576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.899071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.899510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:41.900202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:41.900658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:41.901085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.032056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:42.040084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bc20d8fd-d88d-40bd-babb-e02c97d2ca4b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.153451 Sep 13 13:05:42.040656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 46/102] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:41 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:42.192038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:42.196182 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:42.211106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.218244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.220781 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.222805 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.223442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.224261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.230797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:42.485016 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:42.494788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:42.496605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:42.498149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2f41416-0cde-4246-8c65-0ca1d8d813f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.316060 Sep 13 13:05:42.499327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 57/103] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:42 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:42.670159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:42.672072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:42.679898 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.680685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.686421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.686421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.686421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.686421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.686755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:42.686755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:42.692257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:42.700570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.701422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.702369 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:42.703431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:42.704154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:42.705544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:43.605849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:43.610876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:43.617811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4cb506ec-5de0-4895-8c88-1092a38e4224 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1315 microversion: 2.1 time: 0.936685 Sep 13 13:05:43.619525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 58/104] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:42 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1315 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:43.624923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:43.625590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:43.637104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af1a703d-12db-4023-b48c-c9050076651a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.967470 Sep 13 13:05:43.638757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 47/105] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:42 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:43.654406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:43.654406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:43.654406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:43.654406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:43.655503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:43.655503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:43.664493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:43.678398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:43.688882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:43.689548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:43.690176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:43.694746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:43.694746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:43.694746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.145369 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:44.146234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:44.151640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2d84fb0f-7677-4801-998c-961d93027800 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.493626 Sep 13 13:05:44.153989 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 48/106] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:43 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:44.158201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c7751c1-cdb1-4d51-bf83-7338720cb1fb tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.536596 Sep 13 13:05:44.174413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 59/107] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:43 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:44.180769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:44.181573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:44.188080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.194181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.194181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.194181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.194181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.194819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.654382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:44.660216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:44.664683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:44.673387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:44.675960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:44.677588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6331967b-f402-4b11-b29b-89e7957df8be tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.522429 Sep 13 13:05:44.679736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 49/108] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:44 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:44.680936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.681536 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.682153 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.683026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.683587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.684122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.686182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:44.694544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:44.697023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.697528 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.697996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:44.698702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:44.699727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:44.700355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.212572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.220397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b4dd92e8-ff8e-4679-9fe6-620a643adaf1 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1503 microversion: 2.1 time: 0.571595 Sep 13 13:05:45.221141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 60/109] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:44 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:45.239147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.239986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8e228d-cd12-415d-be09-a5a49b6f72c7", "tag": "ad1412c9-5963-436d-923b-0352d8bd326d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:45.252358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-61b09a7c-297b-4e4f-b2e6-0fe79e0a252f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.570435 Sep 13 13:05:45.253088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 50/110] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:44 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:45.257148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:45.257776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:45.262050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.262997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.263494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.264216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.264755 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.265192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.265914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.266370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.266791 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.280238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] Creating event network-changed:ad1412c9-5963-436d-923b-0352d8bd326d for instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 on hv-cinder-80135 Sep 13 13:05:45.286170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-c4060409-5f35-471e-8a1a-1bb3fb6bd1af req-e17f4a6f-cfc5-488f-b62b-98f294b4d7a2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063413 Sep 13 13:05:45.286931 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 61/111] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:45.296939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:45.297767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:45.304624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.305413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.306083 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.307006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.307542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.308045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.470700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.479370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-134d0b33-5338-4785-851c-eb761d64026a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.225868 Sep 13 13:05:45.479944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 51/112] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:45 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:45.492835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9571f561-e164-4b23-8ffe-8fc0cfcb7321", "tag": "ced03e29-9082-4781-9cd3-50d8f96acb9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:45.499680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.503217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.503692 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.504107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.511448 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-534b4bd5-a21c-45e9-8845-515d87be254b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.216716 Sep 13 13:05:45.511448 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 62/113] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:45 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:45.516886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] Creating event network-changed:ced03e29-9082-4781-9cd3-50d8f96acb9e for instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 on hv-cinder-80135 Sep 13 13:05:45.521975 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-05b78f4a-36c5-4dc0-a628-dbf8f2058888 req-95a8b784-64df-43d3-ae7f-f516fbff384f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Sep 13 13:05:45.522710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 52/114] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:45.708359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:45.709032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:45.715687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.716355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.716790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.717463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:45.717951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:45.718386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:45.846840 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.855491 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.856911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:45.858026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d17d1a78-5190-417c-85b6-ad1ea943b65a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.153758 Sep 13 13:05:45.858566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 63/115] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:45 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:46.279605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:46.280227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:46.286305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.286791 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.287446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.288529 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.288744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.289156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.468972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:46.476830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2e8a35cb-4dd7-4ae4-86ad-7da7610afa4a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.201732 Sep 13 13:05:46.477511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 53/116] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:46 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:46.503198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:46.503811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:46.510268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.510755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.511194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.511879 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.512331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.512829 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.532591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:46.533117 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:46.538958 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.539513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.539945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.540622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.541067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.541480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.723063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:46.731049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de3d8928-f0b7-4723-bedf-2065c4b817cb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.231530 Sep 13 13:05:46.731625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 64/117] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:46 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:46.759780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:46.767934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a000f6f4-0dc0-4c3f-97b5-3373f200b375 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.239448 Sep 13 13:05:46.769177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 54/118] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:46 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:46.885642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:46.889233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:46.900074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.902496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.902792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:46.903506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:46.903959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:46.904541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.031676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42476fd8-5bc5-47f9-8aa9-da3e3012656b", "name": "network-vif-plugged", "status": "completed", "tag": "c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:47.042968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:47.046005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.046697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.047389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.073604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] Creating event network-vif-plugged:c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c for instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b on hv-cinder-80135 Sep 13 13:05:47.079445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8a73b0b0-7b02-4fd2-a9a9-6f6c7b727f81 req-5ace0873-781e-495d-948f-cdeaabf6bdd2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051489 Sep 13 13:05:47.080398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 55/119] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:47.083529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:47.098618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:47.100732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:47.102092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21fbb2e0-ce9e-4e4b-8733-a30e1e227ab0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.221457 Sep 13 13:05:47.102960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 65/120] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:46 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:47.500510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:47.501232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:47.508464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.508944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.509372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.510088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.510574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.510992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.514999 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:47.652261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:47.660043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-073412d4-01b5-4720-825c-10fcf5bb61f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.163753 Sep 13 13:05:47.660609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 56/121] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:47 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:47.754777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:47.755388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:47.762195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.762685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.763146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.767001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.767001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.767001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.795779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:47.796580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:47.804394 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.804988 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.805578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.806386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:47.806834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:47.807491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:47.971987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:47.979984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e6c3fbe-cc11-4646-9b20-1ab34ec67557 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.229021 Sep 13 13:05:47.980634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 66/122] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:47 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:47.997479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:48.005155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c62cdf2e-d306-40af-9cb9-ee89d701ce4f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.214387 Sep 13 13:05:48.005708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 57/123] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:47 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:48.128640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:48.129344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:48.135958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:48.136438 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:48.136892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:48.137612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:48.138127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:48.138603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:48.580141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:48.589481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:48.590989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:48.599501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2e4f53b-810a-471c-b425-b60b0d9d0055 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.468977 Sep 13 13:05:48.599501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 67/124] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:48 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:48.683093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:48.683708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:48.689515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:48.690041 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:48.690482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:48.691408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:48.691744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:48.692180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:48.826507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:48.836688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f69aee42-1d33-4774-a34d-73ecca0fc10f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.157426 Sep 13 13:05:48.837589 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 58/125] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:48 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:49.003349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:49.003952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:49.010781 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.012292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.012292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.012292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.012711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.013125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.027843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:49.028449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:49.034275 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.034760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.035212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.035931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.036384 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.036806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.232208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:49.235589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:49.240102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7767d797-d956-4351-a8f0-8853ccaa48d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.215992 Sep 13 13:05:49.241287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 59/126] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:49 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:49.245966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0a04ea6f-b2b9-4760-b2c6-f5063896e263 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.246276 Sep 13 13:05:49.246128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c8d229-6f99-4c14-a604-11d7a3075530"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:49.246542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 68/127] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:48 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:49.248846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:49.261270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.261789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.262225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.262919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.263369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.263818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.618208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:49.618873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:49.626935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.626935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.626935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.626935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.627403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.627642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.869128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:49.878396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:49.887187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:49.888974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2bd48c1-b356-4c36-b9c9-07649b90c3cc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.275052 Sep 13 13:05:49.890870 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 69/128] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:49 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:05:49.897260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:49.898048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:49.905480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.906251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.906786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:49.907555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:49.908449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:49.909041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.056995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:50.067654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-82a2e3c7-470b-473e-b089-99616097b065 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.173483 Sep 13 13:05:50.067654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 70/129] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:49 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:50.263529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:50.264149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:50.270032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.270563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.271001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.271903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.272449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.272895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.415953 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fabc884a-5c41-445a-a4e9-083c6ddd304e tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "POST /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.173203 Sep 13 13:05:50.417348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 60/130] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:05:49 2022] POST /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:50.423865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:50.433703 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:50.441547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:50.444407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-efcc9933-38bd-4df2-b7a2-404b16815c15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.184604 Sep 13 13:05:50.445372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 71/131] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:50 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:50.462131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.462131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.462131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.462131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.462480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.462480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.607605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:50.615545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2682a1e-aa03-4183-9aa0-3ea4a8ac708e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.196532 Sep 13 13:05:50.616143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 61/132] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:50 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:50.916661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:50.917785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:50.926868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.928351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.929167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:50.930255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:50.930717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:50.931137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.090433 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:51.091049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:51.099169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.106148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.107004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.107656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.108973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.109646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.110321 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.111097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.112851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.117140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-da09eec5-c95c-4578-9634-10d38b6e07e9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.203705 Sep 13 13:05:51.129778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 72/133] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:50 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:51.348781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.358872 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3060c91a-e8c6-4807-8f49-d1cf6d343fa9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1367 microversion: 2.1 time: 0.272288 Sep 13 13:05:51.359916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 62/134] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:51 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:51.474556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:51.475802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:51.481759 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.482255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.482693 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.483388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.483843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.484272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.627661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.640659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:51.641715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:51.643530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9e75a2d-62fe-499d-be5d-c9a780d4c07c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.172130 Sep 13 13:05:51.644562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 73/135] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:51 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:51.648119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.648614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.649051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.653875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:51.653875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:51.653875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:51.850386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:51.858397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eb2c8708-81b3-41a1-9d87-916e4e27c6c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.222941 Sep 13 13:05:51.858976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 63/136] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:51 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:52.145415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:52.146026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:52.152080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.152564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.152993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.153672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.154247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.154665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.171689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:52.175852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "name": "network-vif-plugged", "status": "completed", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:52.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.190617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.191044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.203207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] Creating event network-vif-plugged:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:05:52.208115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e89ed876-cb5a-4368-b7d4-0fb892709c11 req-652b01bf-4c86-4edd-9dfd-f03ea4108356 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036565 Sep 13 13:05:52.208703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 64/137] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:05:52.323000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:52.331827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:52.333966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:52.335380 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab1796aa-d562-44ce-9f64-7f0e70690e87 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.193797 Sep 13 13:05:52.336695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 74/138] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:52 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:52.382845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:52.383539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:52.389877 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.390361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.390789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.391475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.391919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.392584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.669546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:52.670722 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:52.682231 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.684117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.684741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.685556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.688790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.689384 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.764860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:52.773370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7873c95f-c883-410a-aca3-7fd63bfe547b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1557 microversion: 2.1 time: 0.394549 Sep 13 13:05:52.774559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 65/139] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:52 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1557 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:52.797725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:52.798231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:52.804478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.804968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.805400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.806111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.806558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.806979 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.862807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:52.870964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-350d30ad-9444-452b-9e10-c6713206ae52 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.206496 Sep 13 13:05:52.871546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 75/140] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:52 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:52.881994 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:52.882938 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:52.888875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.889362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.889849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.890538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:52.890991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:52.891408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:52.902312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5218209f-3217-4268-97fa-1ec8f56988d6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108443 Sep 13 13:05:52.902940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 66/141] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:05:52 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:05:53.203592 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:53.211852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccd63fdb-37c1-4696-86a5-a2b0d56d0fba tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.334161 Sep 13 13:05:53.212417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 76/142] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:52 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:53.363090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:53.363698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:53.365775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:53.371171 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:53.371639 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:53.372066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:53.372790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:53.373234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:53.373647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:53.776165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:53.784688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:53.786154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:53.787267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a129a8ff-64bd-4623-9b1d-5377a70a2840 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.428664 Sep 13 13:05:53.788033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 67/143] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:53 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:53.894385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:53.895559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:53.905391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:53.908649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:53.908649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:53.908649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:53.908649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:53.909012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.140157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:54.148266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-077243bb-f90b-4588-b6af-e1ec64066d50 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.257922 Sep 13 13:05:54.149012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 77/144] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:53 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:54.226826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11dc092-73fb-4122-9cea-7a41398c3c66", "name": "network-vif-plugged", "status": "completed", "tag": "9537de83-a92f-4647-a5d6-285071c8be74"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:54.239626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:54.245659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:54.251072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.259473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.259473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.259666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.259666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.259666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.259666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.259952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.259952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.263545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] Creating event network-vif-plugged:9537de83-a92f-4647-a5d6-285071c8be74 for instance e11dc092-73fb-4122-9cea-7a41398c3c66 on hv-cinder-80135 Sep 13 13:05:54.268695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-4d1b1b75-44b7-4a08-815b-09354a075b48 req-8897c3b0-2b84-4dca-b9ff-bcf27c429d6d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046141 Sep 13 13:05:54.269670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 68/145] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:54.622233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:54.633989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a99521af-01f3-4740-ae2c-f1c8e6e7ef0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.399698 Sep 13 13:05:54.634657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 78/146] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:54 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:54.805553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42476fd8-5bc5-47f9-8aa9-da3e3012656b", "tag": "c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:05:54.816574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.816574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.816768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:54.816845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.816977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:54.826195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.827372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.828066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.828923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:54.829518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:54.830104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:54.846092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] Creating event network-changed:c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c for instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b on hv-cinder-80135 Sep 13 13:05:54.855065 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-70ec7ce8-4675-49a6-8844-4fd138949b1e req-6c2fe505-34d9-4d03-af09-907fee37cb32 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054182 Sep 13 13:05:54.855744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 69/147] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:05:55.042019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:55.052628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:55.054928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:55.056185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-274f6096-a5b5-4557-adde-e4321be6f1f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.244899 Sep 13 13:05:55.056843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 79/148] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:54 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:55.173230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:55.176505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:55.180799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:55.181292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:55.181755 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:55.182459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:55.182913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:55.183336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:55.328104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:55.338998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-177526bd-0bd5-494f-a06c-128cd09c5e15 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.169869 Sep 13 13:05:55.339731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 70/149] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:55 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:55.658168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:55.659346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:55.682034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:55.682807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:55.683405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:55.686631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:55.687253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:55.687840 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:55.889473 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:55.897440 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1da1479f-fd8b-4bc1-81f7-b2412322b35b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.243627 Sep 13 13:05:55.898565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 80/150] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:55 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:05:56.081963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:56.082599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:56.090315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.091073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.091675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:56.093383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.094407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.095001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:56.277764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:56.286494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:56.288055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:56.291621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e47b0523-7aad-480f-a589-b2aed21975bf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.212115 Sep 13 13:05:56.291621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 71/151] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:56 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:56.363069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:56.364036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:56.378425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.378425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.378425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:56.378425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.378761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.378761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:56.522987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:56.531360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1acd64ca-6c0c-449a-934f-ab5e55c36857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.172156 Sep 13 13:05:56.532510 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 81/152] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:56 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:56.928059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:56.932409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:56.942676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.943171 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.943637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:56.944349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:56.944799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:56.945253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:57.097331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:57.107189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc6af04b-328b-4b6b-8b2a-845b6149dec2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.190348 Sep 13 13:05:57.110187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 72/153] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:56 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:57.316900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:57.321687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:57.328380 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:57.328951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:57.329619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:57.330542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:57.331004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:57.331425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:57.518817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:57.529519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:57.530854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:57.531966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ad3d4c0d-0758-4f8f-99e4-d3610f4875dc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.219579 Sep 13 13:05:57.532789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 82/154] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:57 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:57.564215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:57.564215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:57.572304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:57.572803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:57.576360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:57.577263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:57.578549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:57.581380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:57.750459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:57.753235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:05:57.763889 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-984c1c0f-8df8-4935-934f-26a139ceb4d5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.207821 Sep 13 13:05:57.764668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 73/155] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:57 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:58.132995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:58.133627 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:58.144736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.145419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.146043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.151419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.162044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.162044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.336621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:58.344084 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a9454a8-7f9a-42a6-abf2-cc3c24fc5cbf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.216743 Sep 13 13:05:58.344672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 83/156] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:58 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:58.565432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:58.565432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:58.570394 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.571028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.571830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.574374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.575389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.576305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.727310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:58.735733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:58.737153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:58.738273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e602b535-758d-4f25-ba88-d1127d0ead4e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.181262 Sep 13 13:05:58.738821 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 74/157] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:58 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:58.788096 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:58.789854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:58.796820 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.797313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.797780 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.799018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:58.799687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:58.800121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:58.963034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:58.972869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-429d41b3-4f59-4f1c-b2cd-d1557a999d84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.189002 Sep 13 13:05:58.973449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 84/158] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:58 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:59.370039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:59.370564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:59.377596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:59.378155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:59.378615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:59.379709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:59.380867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:59.381936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:59.530458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:59.539790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29a6b7fd-f7c9-433f-9525-ef718ee5304f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.175099 Sep 13 13:05:59.540404 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 75/159] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:59 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:05:59.763850 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:59.764541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:05:59.770561 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:59.771038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:59.772036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:59.772184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:05:59.773177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:05:59.773609 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:05:59.909158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:59.917760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:59.919193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:05:59.920534 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6c24b51-6733-43ac-99ae-cb3655f3faba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.160352 Sep 13 13:05:59.922276 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 85/160] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:05:59 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:05:59.996805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:05:59.997449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:00.004203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.004689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.005122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:00.005828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.008018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.008018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:00.135444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:00.143017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3597952-77b7-4621-a130-a824cd8ae324 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.150434 Sep 13 13:06:00.143582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 76/161] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:05:59 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:00.562717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:00.563318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:00.569424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.570021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.570500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:00.571187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.571664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.572107 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:00.700766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:00.708479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25034896-c6ff-41a9-a777-197b81db550c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.149470 Sep 13 13:06:00.709036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 86/162] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:00 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:00.950640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:00.950640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:00.953018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.953609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.954153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:00.955314 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:00.955983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:00.957267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:01.102388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:01.110612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:01.112085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:01.113185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6c56c7c-8ff0-47e0-b7a8-e6c481d05797 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1407 microversion: 2.20 time: 0.172607 Sep 13 13:06:01.113792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 77/163] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:00 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:06:01.166426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:01.167091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:01.173318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:01.173827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:01.174257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:01.175012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:01.175455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:01.175869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:01.301125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:01.308911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7c7e60e-d02b-47c3-857e-391133c45fae tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.147213 Sep 13 13:06:01.309468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 87/164] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:01 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:01.732514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:01.734283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:01.743118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:01.743610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:01.744045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:01.744747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:01.745201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:01.745623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:01.879226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:01.887483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-80c14f4d-44c3-43d9-b43c-e6890be11b38 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.160099 Sep 13 13:06:01.889464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 78/165] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:01 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:02.138632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:02.139239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:02.145435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.145967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.151039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.151039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.151039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.151039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.290561 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:02.299556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:02.301055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:02.302246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d652c93-0787-4c27-a97e-ecb946f119c1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1600 microversion: 2.20 time: 0.167535 Sep 13 13:06:02.302807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 88/166] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:02 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:06:02.328994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:02.331894 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:02.332502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:02.339087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.339806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.340399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.340599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:02.341099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.341549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.342161 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.351955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.353312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.353959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.354867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.355466 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.356040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.498192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-759f7826-2503-4187-8a0f-952bde4f2b3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.168427 Sep 13 13:06:02.498192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 79/167] 10.222.0.72 () {60 vars in 1316 bytes} [Tue Sep 13 13:06:02 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:06:02.562611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:02.571480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a297f82c-f9b1-4223-99d2-c6432b168f8e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.243386 Sep 13 13:06:02.572260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 89/168] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:02 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:02.754636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8e228d-cd12-415d-be09-a5a49b6f72c7", "name": "network-vif-plugged", "status": "completed", "tag": "ad1412c9-5963-436d-923b-0352d8bd326d"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:02.765118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.765551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.766001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.777793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] Creating event network-vif-plugged:ad1412c9-5963-436d-923b-0352d8bd326d for instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 on hv-cinder-80135 Sep 13 13:06:02.782870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fb090c8d-dea3-4b5a-90e7-393177c5c2fb req-40570722-531c-4fc8-9319-3d7f67f6a25d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032433 Sep 13 13:06:02.784740 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 80/169] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:02.914123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:02.915101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:02.931005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.933760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.935038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:02.937885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:02.940822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:02.941541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:03.108642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:03.129058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-851a40a4-70f9-4551-aa65-45e7f9d9a7d0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1321 microversion: 2.1 time: 0.220634 Sep 13 13:06:03.141798 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 90/170] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:02 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:03.597545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:03.598920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:03.609317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:03.610375 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:03.610964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:03.612973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:03.613783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:03.614626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:03.817129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:03.832386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4192930e-2f80-4793-9298-9e1103e9b8d2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.239312 Sep 13 13:06:03.836291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 81/171] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:03 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:04.153297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:04.154581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:04.162746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.173662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.174476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.175476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.176295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.177019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.180682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:04.481507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:04.498027 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:04.498331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aa74b70e-33f7-487f-a127-3b43173379ad tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1515 microversion: 2.1 time: 0.348921 Sep 13 13:06:04.499473 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 91/172] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:04 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:04.521100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.521606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.523014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.524747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:04.527717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:04.534272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.534769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.535208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.535901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.537405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.538697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.542419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] Creating event network-changed:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:06:04.545472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-2dedf312-4663-4924-9a4f-ac48cda52cdc req-18b26d27-7e57-49f3-bd9a-ac8f13d73e80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052361 Sep 13 13:06:04.550170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 82/173] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:04.605961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'flavor' on Instance uuid e11dc092-73fb-4122-9cea-7a41398c3c66 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:06:04.807710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9571f561-e164-4b23-8ffe-8fc0cfcb7321", "name": "network-vif-plugged", "status": "completed", "tag": "ced03e29-9082-4781-9cd3-50d8f96acb9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:04.834397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.836615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.838733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.868290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] Creating event network-vif-plugged:ced03e29-9082-4781-9cd3-50d8f96acb9e for instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 on hv-cinder-80135 Sep 13 13:06:04.874411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-16a5f992-cfe8-4845-baca-ea67a17fbb2b req-af9caa46-db3f-4203-b382-54f4e1f12797 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073581 Sep 13 13:06:04.875764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 83/174] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:04.883385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:04.884206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:04.894075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.903028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.903028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:04.903028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:04.903028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:04.903600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.168023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-082408af-31ef-4333-9de6-60e07f59d0c5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66/action" status: 200 len: 32 microversion: 2.1 time: 0.647544 Sep 13 13:06:05.173646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 92/175] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:06:04 2022] POST /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66/action => generated 32 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:06:05.181643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:05.185450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:05.190775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:05.202690 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a0c8e70f-e9fb-4d24-88a5-308a8979e195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.323960 Sep 13 13:06:05.204907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 84/176] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:04 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:05.211996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.214686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:05.215626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.216229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.217674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.218571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:05.219201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.219809 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.234612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.235366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.236011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.237190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.237851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.238448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.260022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:06:05.374280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:05.382476 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6a8b0ec-7c84-4237-8de0-eeb468a5fc5b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.176252 Sep 13 13:06:05.383057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 85/177] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:05 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:05.628008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f2693afb-a563-4fb1-b751-1da2040c692c tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "DELETE /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 204 len: 0 microversion: 2.1 time: 0.457056 Sep 13 13:06:05.628899 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 93/178] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:06:05 2022] DELETE /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:06:05.642054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:05.643976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:05.653904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.654679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.655406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.656630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:05.657495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:05.660562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:05.833681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:05.843272 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-752a5631-432e-41ae-b515-5a4e063ce812 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1555 microversion: 2.1 time: 0.210146 Sep 13 13:06:05.843731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 86/179] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:05 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:06.230539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:06.231162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:06.238474 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.238976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.239413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:06.240314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.240771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.241326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:06.380360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:06.388141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-940837fb-0e32-453c-93cf-781c39104daa tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.162455 Sep 13 13:06:06.388723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 94/180] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:06 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:06.406667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:06.407277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:06.413830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.414319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.414751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:06.415432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.415923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.416346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:06.544004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:06.552075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1d1da39-ab05-422d-9675-2324d7886d0d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.150459 Sep 13 13:06:06.552628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 87/181] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:06 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:06.867059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:06.867662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:06.873570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.874080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.874513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:06.875190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:06.875640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:06.876057 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:07.013386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:07.021587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-37510b6c-c485-4e6f-b155-59cf167428cc tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1555 microversion: 2.1 time: 0.158865 Sep 13 13:06:07.022185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 95/182] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:06 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:07.412635 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:07.413163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:07.419541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:07.420277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:07.420705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:07.421387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:07.421865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:07.422284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:07.554647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:07.562440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c7cb5d88-8637-4961-9221-35feefb5b7f6 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.153795 Sep 13 13:06:07.563015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 88/183] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:07 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:07.580291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:07.580924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:07.587493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:07.591532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:07.591532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:07.591532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:07.591532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:07.591975 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:07.728304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:07.735929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3cff6346-8a0b-43ca-877b-ec9c92413733 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.159877 Sep 13 13:06:07.736490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 96/184] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:07 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:08.045535 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:08.046194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:08.052023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.052511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.052976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:08.054346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.058083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.058083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:08.189124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:08.197400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21719ee7-2746-49b4-885a-3232fdac5986 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1555 microversion: 2.1 time: 0.155808 Sep 13 13:06:08.197997 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 89/185] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:08 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:08.587461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:08.588474 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:08.594877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.595775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.596715 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:08.597621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.598321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.598913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:08.766284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:08.766919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:08.781354 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.781890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.782330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:08.783073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:08.783526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:08.783951 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:09.191030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:09.203201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21bf1f5d-9ba0-45aa-9a0d-127e6108d2a4 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.620294 Sep 13 13:06:09.205731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 97/186] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:08 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:09.206455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:09.218196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38a20a61-8760-4ff6-87e7-d8eba7a67a5c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.462280 Sep 13 13:06:09.219457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 90/187] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:08 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:09.220735 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:09.221519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:09.231728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:09.233096 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:09.233530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:09.234473 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:09.235001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:09.235424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:09.560922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:09.571051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58200516-345c-4010-8546-08294363b8b3 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1555 microversion: 2.1 time: 0.354255 Sep 13 13:06:09.571736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 98/188] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:09 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1555 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:10.126886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860a38df-4d3d-47b0-ba9f-f42a3f7a04ca", "name": "network-vif-deleted", "tag": "f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:10.139360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.139949 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.140478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.153545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] Creating event network-vif-deleted:f5cbd89d-8ab1-4f31-8a04-77680f6ec4a4 for instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca on hv-cinder-80135 Sep 13 13:06:10.158860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-60dcb537-cced-47b0-8ff9-05ec392f53c7 req-98393988-90cd-4aaf-947e-4ef199e8c3b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035474 Sep 13 13:06:10.159770 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 91/189] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:10.229429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:10.230061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:10.236461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.243086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.243086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.243086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.243086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.243432 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.245881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:10.246732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:10.252884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.253475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.254022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.254785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.255325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.255864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.458447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:10.462122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:10.467199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1e3f0a79-8691-4ef0-a033-51512000e577 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.229114 Sep 13 13:06:10.467775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 92/190] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:10 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:10.470604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52524962-7d89-4590-9cd2-47bee1f5929b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1363 microversion: 2.1 time: 0.245944 Sep 13 13:06:10.473815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 99/191] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:10 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:10.596074 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:10.596668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:10.604983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.605587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.606142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.606927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:10.607487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:10.608001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:10.624345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:10.677622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:10.686585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-edbf6eec-ac2f-45e7-889f-1fd4739549ed tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1346 microversion: 2.1 time: 0.095638 Sep 13 13:06:10.696937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 93/192] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:10 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:11.490572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:11.491699 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:11.495429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:11.496037 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:11.498016 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.498649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.499128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.499826 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.500316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.500744 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.502616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.503101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.503538 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.504288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.504743 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.505166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.697857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:11.701455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:11.706423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fd2c06b-2ebe-4cf3-b563-43ace1e2ccf0 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.219756 Sep 13 13:06:11.707347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 100/193] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:11 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:11.713443 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:11.714093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:11.720132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.720573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b889a823-de49-4cf1-834c-c68e0b34f3b2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1549 microversion: 2.1 time: 0.230013 Sep 13 13:06:11.720785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.727888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 94/194] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:11 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:11.728054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.728054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.728054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.728054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.753053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:11.753635 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:11.760599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.761273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.761987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.762724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:11.763263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:11.763858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:11.794382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:11.803159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f05e1720-6d87-47ed-8bd3-15ec872f94fa tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1346 microversion: 2.1 time: 0.094298 Sep 13 13:06:11.804478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 101/195] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:11 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:11.841178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4e8adab-6d7c-4f72-a120-a24d152095f9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092022 Sep 13 13:06:11.841810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 95/196] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:06:11 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:06:12.736841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:12.737675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:12.744120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:12.744859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:12.745333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:12.746072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:12.746525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:12.747178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:12.827209 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:12.828026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:12.834551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:12.835408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:12.835869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:12.836585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:12.837065 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:12.837492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:13.048278 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:13.056540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd7b7f71-d500-42e2-9121-007c7c770a7d tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1346 microversion: 2.1 time: 0.233732 Sep 13 13:06:13.057205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 96/197] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:12 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:13.182398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:13.191830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8418deee-1279-4ebd-afa8-25f9588a6fbd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.459882 Sep 13 13:06:13.192108 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9571f561-e164-4b23-8ffe-8fc0cfcb7321", "tag": "ced03e29-9082-4781-9cd3-50d8f96acb9e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:13.193108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 102/198] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:12 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:13.213254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:13.213829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:13.214321 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:13.226841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] Creating event network-changed:ced03e29-9082-4781-9cd3-50d8f96acb9e for instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 on hv-cinder-80135 Sep 13 13:06:13.231894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0fc8fe0c-8b88-4b0f-9d01-de5f35c1e21c req-e296fd29-8682-41f3-a2ad-1cc493ec5ffd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043806 Sep 13 13:06:13.246308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 97/199] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:06:14.079183 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:14.079926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:14.086399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:14.086890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:14.087319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:14.088011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:14.088456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:14.088873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:14.154048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:14.162428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5f0ed2e2-6a25-40ef-98b2-9d7c7aa47af6 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1346 microversion: 2.1 time: 0.087115 Sep 13 13:06:14.163875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 103/200] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:14 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:14.216663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:14.217845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:14.224561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:14.225823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:14.226297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:14.227254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:14.227914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:14.228415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:14.455366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:14.464428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2de6b6f5-1b5f-46a9-8bed-7412ca4677bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.252731 Sep 13 13:06:14.465161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 98/201] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:14 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:15.186531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:15.188218 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:15.190244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:15.195586 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:15.196070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:15.202364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:15.202364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:15.202364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:15.202364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:15.202679 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:15.228610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:15.229121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:15.229557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:15.230038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lazy-loading 'fault' on Instance uuid 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:06:15.273312 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e54f17d6995f4c099708d79715d95220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaaf8aa87a0f47cc9ba9f477de3c2d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:15.281430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eaf52769-93f9-4d01-b9e4-4941b0d4d98a tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 200 len: 1351 microversion: 2.1 time: 0.098607 Sep 13 13:06:15.282098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 104/202] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:15 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:15.489059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:15.489698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:15.496751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:15.497236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:15.497667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:15.498380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:15.498828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:15.499250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:15.634661 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:15.643721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7ddce991-a6a6-4fe6-bb2e-0253787fd1bc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.158288 Sep 13 13:06:15.644410 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 99/203] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:15 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:16.304421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:16.305046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:16.311525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.312004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.312439 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.313119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.313572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.314020 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.328155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] HTTP exception thrown: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Request method failure captured: Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca HTTP/1.1 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIH_6YqDfi-fPtnEVVpG5PyosOWHYLWEgyeXn8J5inck7fFRPQBXE9WjEFrfVmEVrZ9Vd9KTGXVx9jaDGkJm_tS9wDhRPOhgpIDzpVrd3eM00c8VDUx8pA0yiGsaCV3w9ycKfh437okk0uE-MOJXAVlhfSmZTPaU9SwTaxkzs1oFzGZ0 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:06:16.333123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eaaf8aa87a0f47cc9ba9f477de3c2d67", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: e54f17d6995f4c099708d79715d95220 Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.334816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '860a38df-4d3d-47b0-ba9f-f42a3f7a04ca'} Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:16.335565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.337296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.338390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Returning 404 to user: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:16.338390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5179a49d-f22e-4d48-a94e-20c5382562db tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 404 len: 111 microversion: 2.1 time: 0.034034 Sep 13 13:06:16.338390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 105/204] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:16 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:06:16.455805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:16.457993 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:16.464570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.465058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.465490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.466207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.466781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.467208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.479757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] HTTP exception thrown: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Request method failure captured: Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca/os-volume_attachments HTTP/1.1 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIH_6YqDfi-fPtnEVVpG5PyosOWHYLWEgyeXn8J5inck7fFRPQBXE9WjEFrfVmEVrZ9Vd9KTGXVx9jaDGkJm_tS9wDhRPOhgpIDzpVrd3eM00c8VDUx8pA0yiGsaCV3w9ycKfh437okk0uE-MOJXAVlhfSmZTPaU9SwTaxkzs1oFzGZ0 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:16.484088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eaaf8aa87a0f47cc9ba9f477de3c2d67", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: e54f17d6995f4c099708d79715d95220 Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.485448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'server_id': '860a38df-4d3d-47b0-ba9f-f42a3f7a04ca'} Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:16.486274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:16.487861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:16.488900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Returning 404 to user: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:16.488900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17967fad-4e79-409b-abdb-162b27a80439 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033616 Sep 13 13:06:16.488900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 100/205] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:06:16 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:06:16.668423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:16.669042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:16.675283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.675777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.679359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.679359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:16.679359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:16.679359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:16.812193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:16.819918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5edcbdcf-adca-45ad-8449-f34d4306da44 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.155614 Sep 13 13:06:16.821209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 106/206] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:16 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:17.833341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:17.833877 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:17.841560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.850274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.850274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.850274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.850274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.850710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:17.851168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.851304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:17.851437 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.852189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.852629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.853323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.853801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.854228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.857826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] HTTP exception thrown: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Request method failure captured: Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca HTTP/1.1 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIH_6YqDfi-fPtnEVVpG5PyosOWHYLWEgyeXn8J5inck7fFRPQBXE9WjEFrfVmEVrZ9Vd9KTGXVx9jaDGkJm_tS9wDhRPOhgpIDzpVrd3eM00c8VDUx8pA0yiGsaCV3w9ycKfh437okk0uE-MOJXAVlhfSmZTPaU9SwTaxkzs1oFzGZ0 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:17.860005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eaaf8aa87a0f47cc9ba9f477de3c2d67", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: e54f17d6995f4c099708d79715d95220 Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.861502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '860a38df-4d3d-47b0-ba9f-f42a3f7a04ca'} Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:17.862311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.863673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.864935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Returning 404 to user: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:17.864935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a97c62dc-5422-4b32-9d69-b34ffa056352 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "DELETE /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 404 len: 111 microversion: 2.1 time: 0.031848 Sep 13 13:06:17.864935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 101/207] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:06:17 2022] DELETE /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:06:17.869715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:17.870595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] [instance: 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:17.876736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.878656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.878656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.878656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:17.879131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:17.879368 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:17.894239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] HTTP exception thrown: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Request method failure captured: Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca HTTP/1.1 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIH_6YqDfi-fPtnEVVpG5PyosOWHYLWEgyeXn8J5inck7fFRPQBXE9WjEFrfVmEVrZ9Vd9KTGXVx9jaDGkJm_tS9wDhRPOhgpIDzpVrd3eM00c8VDUx8pA0yiGsaCV3w9ycKfh437okk0uE-MOJXAVlhfSmZTPaU9SwTaxkzs1oFzGZ0 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:17.895764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eaaf8aa87a0f47cc9ba9f477de3c2d67", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eaaf8aa87a0f47cc9ba9f477de3c2d67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: eaaf8aa87a0f47cc9ba9f477de3c2d67 Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-DeleteServersTestJSON-339551159 Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: e54f17d6995f4c099708d79715d95220 Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-DeleteServersTestJSON-339551159-project Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.897124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '860a38df-4d3d-47b0-ba9f-f42a3f7a04ca'} Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:17.897948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. Sep 13 13:06:17.900428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:17.901730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] Returning 404 to user: Instance 860a38df-4d3d-47b0-ba9f-f42a3f7a04ca could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:17.901730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-580a5ad8-4117-431a-bf41-d02406443d38 tempest-DeleteServersTestJSON-339551159 tempest-DeleteServersTestJSON-339551159-project] 10.222.0.72 "GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca" status: 404 len: 111 microversion: 2.1 time: 0.031142 Sep 13 13:06:17.904444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 102/208] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:17 2022] GET /compute/v2.1/servers/860a38df-4d3d-47b0-ba9f-f42a3f7a04ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:06:18.017936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:18.026364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7e6bab5c-eda1-4d9c-9356-d0402c3b8139 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.186456 Sep 13 13:06:18.027385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 107/209] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:17 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:19.049269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:19.049913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:19.056951 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:19.057439 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:19.057911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:19.058626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:19.059084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:19.059510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:19.262440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:19.284957 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a406aa80-a235-4d8a-9a91-b479cc9eeeec tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.239465 Sep 13 13:06:19.294976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 103/210] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:19 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:20.319500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:20.322120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:20.333067 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:20.333991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:20.334612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:20.336545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:20.337778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:20.338595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:20.539539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:20.548245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56c797fe-afa3-4c63-b3a3-94e95decb538 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.234121 Sep 13 13:06:20.549085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 108/211] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:20 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:21.576406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:21.577040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:21.584560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:21.585284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:21.588322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:21.591381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:21.592877 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:21.593491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:21.798290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:21.814083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f3633085-e3a4-4e2f-ae29-97da1e687816 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.238055 Sep 13 13:06:21.814083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 104/212] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:21 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:22.834405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:22.835013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:22.840992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:22.841471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:22.841946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:22.842626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:22.843075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:22.843495 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:22.983249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:22.991253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-19d63635-f71f-49e1-a2aa-07ef25b6d1e1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.160839 Sep 13 13:06:22.992491 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 109/213] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:22 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:24.014739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:24.015344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:24.017819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=76 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:24.022700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:24.024149 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:24.024586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:24.025268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:24.025717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:24.026157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:24.159636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:24.167489 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7c9f447-d675-4d7e-8cea-7bfdfdab0d45 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.156547 Sep 13 13:06:24.172379 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 105/214] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:24 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:24.510591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5c7ca47-5a6e-4027-a1b0-34b87be5959e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Action: 'create', calling method: .version_select at 0x7f15668ef820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-235881558", "metadata": {"Type": "work"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5c7ca47-5a6e-4027-a1b0-34b87be5959e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 121 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:06:24.522951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-235881558", "metadata": {"Type": "work"}}} Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: Sep 13 13:06:24.531093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-235881558', 'metadata': {'Type': 'work'}}}} Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.532450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 13:06:24.534186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 13:06:24.536006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 13:06:24.536006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.536006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5c7ca47-5a6e-4027-a1b0-34b87be5959e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.536006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5c7ca47-5a6e-4027-a1b0-34b87be5959e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135758 Sep 13 13:06:24.536006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 110/215] 10.222.0.72 () {60 vars in 1156 bytes} [Tue Sep 13 13:06:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:06:24.539060 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17442fcd-2c32-4d8a-9662-9fcde0ebc48c tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Action: 'create', calling method: .version_select at 0x7f156522c790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1751901902", "metadata": {"Type": "work"}}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17442fcd-2c32-4d8a-9662-9fcde0ebc48c tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 120 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:24.543831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1751901902", "metadata": {"Type": "work"}}} Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:06:24.547195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1751901902', 'metadata': {'Type': 'work'}}}} Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise error Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi '0' Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.548055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 13:06:24.549450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 13:06:24.551104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 13:06:24.551104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.551104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17442fcd-2c32-4d8a-9662-9fcde0ebc48c tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.551104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17442fcd-2c32-4d8a-9662-9fcde0ebc48c tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014602 Sep 13 13:06:24.551104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 106/216] 10.222.0.72 () {60 vars in 1156 bytes} [Tue Sep 13 13:06:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 13:06:24.556736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-161971d5-69f4-428d-a64c-cbf342fe7076 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Action: 'create', calling method: .version_select at 0x7f15651f1040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-821915354", "metadata": {"Type": "work"}}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-161971d5-69f4-428d-a64c-cbf342fe7076 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 118 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:06:24.560372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-821915354", "metadata": {"Type": "work"}}} Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: Sep 13 13:06:24.561802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-821915354', 'metadata': {'Type': 'work'}}}} Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise error Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi '' Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.562808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 13:06:24.564285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 13:06:24.565351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 13:06:24.565351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.565351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-161971d5-69f4-428d-a64c-cbf342fe7076 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.565351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-161971d5-69f4-428d-a64c-cbf342fe7076 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009762 Sep 13 13:06:24.565351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 111/217] 10.222.0.72 () {60 vars in 1156 bytes} [Tue Sep 13 13:06:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 13:06:24.570996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6e87f52-4bf1-427f-82cb-57431ceac4a9 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Calling method '.version_select at 0x7f15652349d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:24.599962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a6e87f52-4bf1-427f-82cb-57431ceac4a9 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] HTTP exception thrown: Volume tempest-invalid-1572654441 could not be found. Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6e87f52-4bf1-427f-82cb-57431ceac4a9 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1572654441 HTTP/1.1 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:24.602425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Volume tempest-invalid-1572654441 could not be found. Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'tempest-invalid-1572654441'} Sep 13 13:06:24.603820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1572654441 could not be found. (HTTP 404) (Request-ID: req-f366493e-ba4c-49cb-81a0-257994a94e7f) Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.604637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:06:24.605667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1572654441 could not be found. Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:24.606716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1572654441 could not be found. Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1572654441 could not be found. Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6e87f52-4bf1-427f-82cb-57431ceac4a9 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 404 to user: Volume tempest-invalid-1572654441 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6e87f52-4bf1-427f-82cb-57431ceac4a9 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1572654441" status: 404 len: 99 microversion: 2.1 time: 0.036724 Sep 13 13:06:24.607742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 107/218] 10.222.0.72 () {58 vars in 1218 bytes} [Tue Sep 13 13:06:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1572654441 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 13:06:24.615404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0fd5acee-4cb3-4df1-9afb-42b1c865a952 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004323 Sep 13 13:06:24.615882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 112/219] 10.222.0.72 () {58 vars in 1140 bytes} [Tue Sep 13 13:06:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 13:06:24.628180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b3d81f3c-31b9-4bf6-917e-5b883e909bc6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003748 Sep 13 13:06:24.628666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 108/220] 10.222.0.72 () {58 vars in 1137 bytes} [Tue Sep 13 13:06:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 13:06:24.642111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e437f835-aff1-4c41-af79-0e80370522b6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Calling method '.version_select at 0x7f15654f0dc0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:24.671481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e437f835-aff1-4c41-af79-0e80370522b6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] HTTP exception thrown: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e437f835-aff1-4c41-af79-0e80370522b6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-volumes/b6d1d379-301d-44cd-b1e3-ee792e234908 HTTP/1.1 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:06:24.675070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'b6d1d379-301d-44cd-b1e3-ee792e234908'} Sep 13 13:06:24.681600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. (HTTP 404) (Request-ID: req-cc3acf68-d2c4-4b60-959f-541453b2707c) Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.682485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:06:24.683689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 13:06:24.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e437f835-aff1-4c41-af79-0e80370522b6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 404 to user: Volume b6d1d379-301d-44cd-b1e3-ee792e234908 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e437f835-aff1-4c41-af79-0e80370522b6 tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b6d1d379-301d-44cd-b1e3-ee792e234908" status: 404 len: 109 microversion: 2.1 time: 0.038466 Sep 13 13:06:24.686137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 113/221] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:06:24 2022] DELETE /compute/v2.1/os-volumes/b6d1d379-301d-44cd-b1e3-ee792e234908 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:06:24.687207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a86c8b6-4be0-487c-a197-eb933200e34e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Calling method '.version_select at 0x7f156522cf70>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:24.715307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-4a86c8b6-4be0-487c-a197-eb933200e34e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] HTTP exception thrown: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a86c8b6-4be0-487c-a197-eb933200e34e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Request method failure captured: Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/874d7ccd-48a4-4b43-90ec-e9508f0d2a00 HTTP/1.1 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIBQtHORxyK7BTf68f_eYAqeOY8aDCuhw225c9zgSm04-OtGD-JAAjftX1HMmiIu_EnA7SwUejWUgK0OH9-NIdlGd-wYQP20SCpZHezEvF7VSuxb_bl-2znDHF6C-JNhjX-JPwhFC-VKjuI9eGleTvO9b6HNrjrNhIjnHbnAzVQBy3c Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:06:24.715751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_942aba47b5e2439a9bdd2e52f25f3290", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/942aba47b5e2439a9bdd2e52f25f3290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 942aba47b5e2439a9bdd2e52f25f3290 Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesNegativeTest-2138420460 Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: b496850076a5466a9f7e07aee3bc1ed4 Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesNegativeTest-2138420460-project Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '874d7ccd-48a4-4b43-90ec-e9508f0d2a00'} Sep 13 13:06:24.717145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. (HTTP 404) (Request-ID: req-4361b2e9-9f2b-494b-806c-9054a3ae99f8) Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.717992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:06:24.718992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 13:06:24.720047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a86c8b6-4be0-487c-a197-eb933200e34e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] Returning 404 to user: Volume 874d7ccd-48a4-4b43-90ec-e9508f0d2a00 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a86c8b6-4be0-487c-a197-eb933200e34e tempest-VolumesNegativeTest-2138420460 tempest-VolumesNegativeTest-2138420460-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/874d7ccd-48a4-4b43-90ec-e9508f0d2a00" status: 404 len: 109 microversion: 2.1 time: 0.034768 Sep 13 13:06:24.721144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 109/222] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:06:24 2022] GET /compute/v2.1/os-volumes/874d7ccd-48a4-4b43-90ec-e9508f0d2a00 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:06:25.192137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:25.192818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:25.200891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:25.201443 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:25.201897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:25.202633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:25.203092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:25.203524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:25.339999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:25.347712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86a3e647-05e0-4b82-b86e-0116a0e644c9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.160313 Sep 13 13:06:25.348266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 114/223] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:25 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:26.373139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:26.373875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:26.379819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:26.380376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:26.380888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:26.381657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:26.382954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:26.383647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:26.534907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:26.543245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0635da81-44f0-42dd-a3a3-f4d18fa65587 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.176272 Sep 13 13:06:26.545625 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 110/224] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:26 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:27.581237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:27.581888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:27.588042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:27.588527 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:27.589118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:27.590015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:27.590461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:27.590875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:27.746427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:27.754508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e67297ee-8812-4441-9a35-f69cc25be8db tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.177123 Sep 13 13:06:27.769945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 115/225] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:27 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:28.778786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:28.779398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:28.785646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:28.786227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:28.786666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:28.787350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:28.787801 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:28.788222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:28.936814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:28.946934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6633dc82-7b93-4ee7-8ffb-ad2c3f805cb5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.171140 Sep 13 13:06:28.953807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 111/226] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:28 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:29.970515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:29.972028 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:29.979177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:29.979842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:29.980467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:29.981466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:29.982229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:29.982961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:30.121095 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:30.129113 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6815912-0f59-4310-b9ec-2cec043bc196 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.163206 Sep 13 13:06:30.129678 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 116/227] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:29 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:31.152874 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:31.153604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:31.160137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:31.160704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:31.161208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:31.161994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:31.162521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:31.163022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:31.298076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:31.305982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3a541ac8-0b91-4b4b-b195-1259439a4e78 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.156968 Sep 13 13:06:31.306543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 112/228] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:31 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:32.330125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:32.330731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:32.337210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:32.338535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:32.338535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:32.338898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:32.339346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:32.339765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:32.477114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:32.486085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-447a3dc9-3eab-4722-8955-e3f3c18c602d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.159663 Sep 13 13:06:32.497866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 117/229] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:32 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:33.519050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:33.520345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:33.537044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:33.537549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:33.540135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:33.540864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:33.541405 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:33.542081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:33.685683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:33.694170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7003b303-b8e9-41c6-b261-92e85ba25470 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.178993 Sep 13 13:06:33.694268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 113/230] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:33 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:34.716726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:34.717359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:34.723269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:34.723747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:34.724178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:34.724856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:34.725294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:34.725771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:34.867508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:34.875479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-675a5680-b161-41d3-8afb-877d4f0797cf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.162530 Sep 13 13:06:34.876054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 118/231] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:34 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:35.898501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:35.899261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:35.905804 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:35.906298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:35.906761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:35.907564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:35.908013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:35.908432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:36.043236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:36.051385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-009676d2-494c-4139-8e8c-0c48337c791e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.156976 Sep 13 13:06:36.051939 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 114/232] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:35 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:37.075078 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:37.076268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:37.082341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:37.082829 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:37.083582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:37.084280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:37.084727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:37.085402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:37.217256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:37.225089 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-427946af-eb8a-4602-a893-f021fe0e76fe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.153817 Sep 13 13:06:37.237924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 119/233] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:37 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:38.248423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:38.249038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:38.255564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:38.256047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:38.256478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:38.257722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:38.258196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:38.258621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:38.397100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:38.404810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-35c4eb29-c1a4-406e-afe3-0e4a539acb54 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.160277 Sep 13 13:06:38.405365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 115/234] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:38 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:39.427752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:39.428363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:39.434526 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:39.435014 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:39.435505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:39.436174 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:39.436624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:39.437053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:39.562559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:39.573131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-049d3660-c4f4-457f-8029-8b3445297cc8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.147779 Sep 13 13:06:39.573131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 120/235] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:39 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:40.324859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:40.325940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:40.332263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:40.332750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:40.333185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:40.333929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:40.334393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:40.334808 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:40.358744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-152d5645-bcab-4bed-9893-a1ad2007dab0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037774 Sep 13 13:06:40.359515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 116/236] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:06:40 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:40.595001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:40.595769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:40.603198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:40.603772 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:40.604275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:40.605080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:40.605599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:40.606120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:40.744115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:40.751734 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-eec2796d-222a-4faf-bb9f-d7291b569d88 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.160831 Sep 13 13:06:40.752300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 121/237] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:40 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:41.774585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:41.778805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:41.781333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:41.781843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:41.782273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:41.782967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:41.783420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:41.783872 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:41.787828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:41.917819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:41.926751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8176bc6c-123c-4924-8452-c20431b0eeaf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.156200 Sep 13 13:06:41.927317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 117/238] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:41 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:42.357871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72ceebaf-1fdc-4442-a872-38aa50736b27"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:42.359142 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:42.370083 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:42.370882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:42.371694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:42.372718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:42.373542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:42.374136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:42.949170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:42.949811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:42.956521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:42.957005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:42.957449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:42.958183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:42.958638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:42.959066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:43.095007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:43.103413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d2e6d0f-2529-43aa-9a60-01167efb3961 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.158020 Sep 13 13:06:43.103915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 118/239] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:42 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:43.207606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3ec86d1-89ee-4038-b22b-0454c01f6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857015 Sep 13 13:06:43.208309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 122/240] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:06:42 2022] POST /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:44.126595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:44.127369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:44.134610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:44.135098 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:44.135535 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:44.136230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:44.136681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:44.137106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:44.296486 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:44.304986 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-753a75a4-20ed-4787-a6f9-2575213067f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.181673 Sep 13 13:06:44.305630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 119/241] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:44 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:45.328168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:45.328860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:45.331869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=32 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:45.336844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:45.337332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:45.337791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:45.338485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:45.338934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:45.339355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:45.494055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:45.496283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:45.502316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d27e4f0e-4973-4d9a-9771-f9a72b0d6d9e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.178887 Sep 13 13:06:45.502885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 123/242] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:45 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:46.526840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:46.527450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:46.533481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:46.534010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:46.534445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:46.535131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:46.535591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:46.536070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:46.671176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:46.680506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a15dba11-b73a-47a3-b20b-964a48a9c0cd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.158640 Sep 13 13:06:46.681479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 120/243] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:46 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:47.706999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:47.707629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:47.715554 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:47.716047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:47.716674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:47.717384 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:47.717870 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:47.720151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:47.903478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:47.911416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc475c82-9007-4c6d-b065-7cf64adc1c87 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.210501 Sep 13 13:06:47.911989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 124/244] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:47 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:48.936611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:48.937215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:48.944121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:48.944617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:48.945054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:48.945785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:48.946862 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:48.947518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:49.092881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:49.102084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-970b1212-a44e-47aa-a34f-058e9b02b653 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1521 microversion: 2.1 time: 0.167706 Sep 13 13:06:49.102084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 121/245] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:48 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:50.128662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:50.129415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:50.138069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.138627 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.139067 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.139931 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.140392 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.140818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.177502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:50.178615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:50.187059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.187827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.188432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.189304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.190273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.190897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.263740 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8127e894-d8cf-4d1a-abbe-66f3d008a15e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/ips" status: 200 len: 153 microversion: 2.20 time: 0.090316 Sep 13 13:06:50.264569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 122/246] 10.222.0.72 () {60 vars in 1289 bytes} [Tue Sep 13 13:06:50 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/ips => generated 153 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 13:06:50.545805 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:50.556337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bab788d6-f576-42cb-b5f1-4b12d543f90f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1501 microversion: 2.1 time: 0.433427 Sep 13 13:06:50.556337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 125/247] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:50 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1501 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:50.578204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:50.578917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:50.585051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.585544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.586018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.586791 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:50.587253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:50.587712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:50.740723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:50.749820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d6ec76b0-eec8-4afc-a548-a1b6adb37daf tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1517 microversion: 2.1 time: 0.175677 Sep 13 13:06:50.750522 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 123/248] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:50 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:52.225917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a6af8a0-e8d8-4bfc-8a62-1990ce8e76f4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: .version_select at 0x7f1565169a60>, body: {"keypair": {"name": "tempest-keypair-1348147034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzTMjQYudVIsjDwQPF8tY15YriA3DntLkPVZromLuj+Nu5vowPb4sZYW39l+9/VD7AV5qtAKsDUlFIdPMMEEDXCefvPvfRBAJ+Q3jJ/gqz/g6I3VdFyKf4MU6kraaFYGA=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:52.242501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-9a6af8a0-e8d8-4bfc-8a62-1990ce8e76f4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:06:52.247510 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-9a6af8a0-e8d8-4bfc-8a62-1990ce8e76f4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:06:52.387878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a6af8a0-e8d8-4bfc-8a62-1990ce8e76f4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165661 Sep 13 13:06:52.388599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 126/249] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:06:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:06:52.894067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:52.896358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:52.902751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:52.903239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:52.903665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:52.904351 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:52.904802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:52.905216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:52.935803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'flavor' on Instance uuid 4e8e228d-cd12-415d-be09-a5a49b6f72c7 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:06:53.516393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a70683ec-7a29-4c2c-819b-05959ea33787 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/action" status: 200 len: 32 microversion: 2.1 time: 0.626393 Sep 13 13:06:53.517650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 124/250] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:06:52 2022] POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/action => generated 32 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:06:53.528171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:53.532310 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:53.547465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:53.547974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:53.548421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:53.549145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:53.549621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:53.550073 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:53.775139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:53.776014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:53.791618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:53.792507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:53.793098 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:53.794249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:53.798217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:53.799379 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:53.803669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:53.817155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5f7730a-cddb-4d57-b919-c77601457353 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.293639 Sep 13 13:06:53.817764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 127/251] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:53 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:53.861097 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lazy-loading 'flavor' on Instance uuid 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:06:54.684062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-594ab0f9-dec3-4419-9d5c-cdb78ba6efa2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/action" status: 202 len: 0 microversion: 2.20 time: 0.901830 Sep 13 13:06:54.717426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 125/252] 10.222.0.72 () {62 vars in 1319 bytes} [Tue Sep 13 13:06:53 2022] POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/action => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:06:54.726561 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:54.728845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:54.736074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:54.736561 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:54.736990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:54.737674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:54.738376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:54.739009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:54.842554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:54.843611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:54.847761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=34 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:54.855906 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:54.860442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:54.860442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:54.860442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:54.860442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:54.860871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:55.079127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:55.087799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00c3ab67-1976-4dea-8d57-4a3637a37a7b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.249381 Sep 13 13:06:55.088378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 126/253] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:54 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:55.113591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:55.124628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:55.126563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:55.129406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db9f1d56-8ac7-4d54-8412-24d9471650d0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.406835 Sep 13 13:06:55.130798 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 128/254] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:54 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:06:56.111696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:56.113405 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:56.122852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:56.123870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:56.124521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:56.125415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:56.126053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:56.127404 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:56.155926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:56.157240 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:56.169305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:56.174531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:56.174531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:56.174531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:56.174531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:56.174856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:56.393502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:56.396091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:56.406218 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2894a60d-ffc8-474f-b641-d585d68a0a60 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.298965 Sep 13 13:06:56.407202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 127/255] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:56 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:56.409695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:56.411162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:56.414188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8b6f2ebc-dab8-40fc-9b5e-e57b9b09855a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.260460 Sep 13 13:06:56.414596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441409651", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f0b8231-ada5-4945-87a4-d1b052328819"}], "security_groups": [{"name": "tempest-securitygroup--733520458"}], "key_name": "tempest-keypair-1348147034", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:06:56.416691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 129/256] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:56 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:06:56.539157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] validate_networks() for [('1f0b8231-ada5-4945-87a4-d1b052328819', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:06:57.027875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:06:57.028548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:06:57.029227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:06:57.030091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:06:57.030846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:06:57.043176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.044143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.044733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.045617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.046877 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.047614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.072633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:06:57.078144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:06:57.091142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:06:57.093884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:06:57.279665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-469ff071-5f84-45c0-bd49-8f5b79c811de tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.871046 Sep 13 13:06:57.288381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 128/257] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:06:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:06:57.291500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c695e354-b1ba-4d6f-bb5d-6aac80c296af tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:57.292207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c695e354-b1ba-4d6f-bb5d-6aac80c296af tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:57.378283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c695e354-b1ba-4d6f-bb5d-6aac80c296af tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:57.388475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c695e354-b1ba-4d6f-bb5d-6aac80c296af tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1241 microversion: 2.1 time: 0.100280 Sep 13 13:06:57.389579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 130/258] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:57 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:57.431209 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:57.432269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:57.440582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:57.441204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:57.452926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.453424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.455095 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.455986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.458790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.459539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.469660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.472420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.475135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.476077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:57.481168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:57.484868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:57.789401 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:57.797833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:57.800045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38ba04ad-6fb9-4b99-a005-9274ff00c76e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.373061 Sep 13 13:06:57.800392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 129/259] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:57 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:06:57.827847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:57.831492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:57.833690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-319f4fc5-e416-4435-8ee7-eaaed612792c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.397179 Sep 13 13:06:57.835664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 131/260] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:57 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:06:58.412038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b9b00f26-9c23-417c-a1f5-044bcda90ae1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:58.416783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b9b00f26-9c23-417c-a1f5-044bcda90ae1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:58.481892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b9b00f26-9c23-417c-a1f5-044bcda90ae1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:58.490039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b9b00f26-9c23-417c-a1f5-044bcda90ae1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1241 microversion: 2.1 time: 0.081629 Sep 13 13:06:58.491487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 130/261] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:58 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:58.827164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:58.828434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:58.837304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:58.837839 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:58.839342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:58.840157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:58.842568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:58.842568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:58.868624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:58.869595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:58.880401 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:58.882130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:58.883350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:58.884914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:58.886034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:58.887223 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:59.090364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:59.100124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee933306-3daa-4438-aaa2-ba7aa9852a67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.279326 Sep 13 13:06:59.100707 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 132/262] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:58 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:06:59.141701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:59.144447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:06:59.154064 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:59.155966 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:59.157547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc1aefa0-196c-4105-aab9-a6f383aedfc8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.293687 Sep 13 13:06:59.158704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 131/263] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:06:58 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:06:59.517382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:06:59.518070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:06:59.526827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:59.528378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:59.529142 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:59.530037 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:06:59.531480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:06:59.532009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:06:59.625758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:06:59.636824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee422590-3730-487d-86d0-3ffb0438c136 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1293 microversion: 2.1 time: 0.122223 Sep 13 13:06:59.639827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 133/264] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:06:59 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:00.137571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:00.137571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:00.142552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.143055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.143502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.144216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.144679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.145110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.161005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:00.166277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:00.168136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.168867 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.169310 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.170247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.170905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.171382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.198702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cfae1d84-a523-43e4-bb75-7fbddeaabe1f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/ips" status: 200 len: 146 microversion: 2.1 time: 0.041741 Sep 13 13:07:00.205982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 134/265] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:07:00 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:00.211802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:00.212674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:00.218996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.219788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.220232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.220925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.221583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.222045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.417588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:00.421923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a80603e5-ea91-47ed-8e86-6d62d5b8c22c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.300648 Sep 13 13:07:00.423157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 132/266] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:00 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:00.492558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:00.506023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:00.509490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:00.512052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1746765-4b95-4ac0-846b-156ef176f4d7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.305055 Sep 13 13:07:00.513175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 135/267] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:00 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:00.666116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:00.667491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:00.675527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.676295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.676926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.681154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:00.681154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:00.681154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:00.816840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:00.828019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ef38d11-8c2b-4e0d-8933-270688d58417 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1301 microversion: 2.1 time: 0.168648 Sep 13 13:07:00.828770 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 133/268] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:00 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:01.448318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:01.449043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:01.462843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.466567 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.466567 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:01.472803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.473653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.474347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:01.541231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:01.542972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:01.560613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.562858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.582347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:01.587112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.588442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.588899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:01.909900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:01.929817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-44a1ef4b-133c-453a-b27c-f00d404be6d3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.486485 Sep 13 13:07:01.949498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 136/269] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:01 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:01.959060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:01.965118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:01.980477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.983613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.984300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:01.986348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:01.987903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:01.989397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:02.025696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:02.038353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:02.042386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:02.049660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9a3f5879-57f2-43f5-a859-75256f74c23f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.509492 Sep 13 13:07:02.056492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 134/270] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:01 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:02.232227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:02.247806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a731218-f1eb-4dc9-a3f8-7f9f0cffd84e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.298485 Sep 13 13:07:02.249924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 137/271] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:01 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:03.066485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:03.066485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:03.066485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.066485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.070372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.070372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.070372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.070372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.081446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:03.082197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:03.092702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.093332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.093958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.095844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.096534 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.097140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.131561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:03.141173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3beac6a2-dffb-4f01-939d-8bac6fc7462e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.180155 Sep 13 13:07:03.141791 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 135/272] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:02 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:03.276886 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:03.280883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:03.281510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:03.294722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.295681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:03.296569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.297570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.298599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:03.301050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.301468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96d6c972-fdd8-47b4-8bae-0509ba89841b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.224313 Sep 13 13:07:03.301955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.303753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 138/273] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:03 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:03.306655 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.700779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:03.713444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ded8210f-7541-4759-8c59-55ec21a40db9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.436556 Sep 13 13:07:03.716189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 136/274] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:03 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:03.800574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b866cd90-d914-4d85-9540-c2bc6fc1e940"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:03.803967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:03.824148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.824592 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.826501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:03.827264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:03.829108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:03.830713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.158737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc", "tag": "e42f6f1f-ed4b-41d3-a2b4-ba1b11365103"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:04.172956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.178819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.178819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.186315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] Creating event network-changed:e42f6f1f-ed4b-41d3-a2b4-ba1b11365103 for instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc on hv-cinder-80135 Sep 13 13:07:04.191713 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-46878759-f23e-422a-989e-24bc6fff6e76 req-1c33b3bb-180f-4164-866e-d6a13171e3a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037546 Sep 13 13:07:04.192651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 137/275] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:04.198212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:04.198997 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:04.205628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.206148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.206584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.207468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.207920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.208339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.505613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:04.519307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c99bd3f5-88b3-4059-971f-fa7414aa47a3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.325486 Sep 13 13:07:04.520243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 138/276] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:04 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:04.533518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:04.534600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:04.544327 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.550746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.554452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.554452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.554452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.554452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.906287 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d0ed08e-6a0e-4d79-9de8-09f4e0dd55ab tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109729 Sep 13 13:07:04.907925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 139/277] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:07:03 2022] POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:04.919367 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:04.920302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:04.927851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.928354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.928831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:04.929550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:04.930771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:04.931358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:05.059226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:05.076185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:05.078003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:05.079447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aaf65c2c-1a04-4628-8afd-6dd17b5f24ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.557920 Sep 13 13:07:05.080331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 139/278] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:04 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:05.222373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:05.235923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04940bd4-d677-4ab3-9a0f-75fe2c334b8d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.326567 Sep 13 13:07:05.236711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 140/279] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:04 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:05.544536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:05.545152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:05.568138 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:05.569072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:05.569689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:05.571346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:05.572012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:05.572749 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:05.752471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:05.761415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7897b132-0a5f-4828-bf51-fd0b90755374 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.221536 Sep 13 13:07:05.762294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 140/280] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:05 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:06.113535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:06.115182 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:06.124350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.125190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.125881 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:06.127241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.127929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.129244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:06.162323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:06.260337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:06.262039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:06.279065 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.279828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.280414 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:06.282073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.282680 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.284791 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:06.431665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:06.457883 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:06.460324 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:06.462574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6d64d7e-fbf5-454a-ac76-3543c559d371 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.355817 Sep 13 13:07:06.463363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 141/281] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:06 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:06.529775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:06.544611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0bec006a-17e5-4c9d-ad38-9957d2e15270 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.287278 Sep 13 13:07:06.546096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 141/282] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:06 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:06.795516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:06.796137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:06.811767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.812292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.812924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:06.814151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:06.814607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:06.815148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:07.001551 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:07.012282 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-529cf72b-a276-4cbb-892b-35966be7d02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.226040 Sep 13 13:07:07.013522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 142/283] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:06 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:07.488990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:07.489608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:07.496885 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:07.499231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:07.500782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:07.502430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:07.503416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:07.503880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:07.504451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:07.573805 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:07.575102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:07.581315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:07.583621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:07.583992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:07.584626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:07.585689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:07.586583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:07.587612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:07.869877 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:07.883923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:07.885464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:07.886394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:07.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ca3ef73b-037e-4004-883a-b750334dbf3b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.401907 Sep 13 13:07:07.899928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9103b15d-6407-4f0b-a47b-a3ad885d14a1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.331247 Sep 13 13:07:07.902054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 143/284] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:07 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:07.907408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 142/285] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:07 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:08.037216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:08.037964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:08.045192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:08.045824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:08.046514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:08.048131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:08.048794 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:08.049449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:08.288398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:08.297670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dc92c310-66f5-4f9b-8a6f-4a0757397bf5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.264594 Sep 13 13:07:08.309868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 144/286] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:08 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:08.732428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:08.912824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:08.913487 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:08.920980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:08.921468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:08.921940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:08.922853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:08.923475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:08.923886 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.007910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3bff83c-2f74-4660-ab42-913f485d23f5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Action: 'create', calling method: .version_select at 0x7f1565374790>, body: {"keypair": {"name": "tempest-TestShelveInstance-474635815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSyZOfx4FFiwrhiMC/lYsA/uNunVIoDautyrwGXyBJrwJBO2GwT2HdFRiIXsGe7IvbOx/py6oy0LJmfiwXmLAG6sAGqhJ0rcZ1Sxj2/Vi2KuXgxgy2Og25UOd54P7OQwQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:09.031028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-a3bff83c-2f74-4660-ab42-913f485d23f5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Getting quotas for project 9788b5b66a0c452cb39b263ca30284e0. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:07:09.035028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-a3bff83c-2f74-4660-ab42-913f485d23f5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Getting quotas for user 4690104f5bea480d87b7c43488182441 and project 9788b5b66a0c452cb39b263ca30284e0. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:07:09.077003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:09.085279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:09.087364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:09.088515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-672d09c9-582a-4dc9-a44d-56e229442b2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.180287 Sep 13 13:07:09.089075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 145/287] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:08 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:09.093382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:09.094004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:09.099642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.105860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.105860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.105860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.105860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.106299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.147686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3bff83c-2f74-4660-ab42-913f485d23f5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.422854 Sep 13 13:07:09.148303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 143/288] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:07:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:09.243791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:09.275992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-586622a1-1de9-491d-8aed-ac3a60d301ab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.185826 Sep 13 13:07:09.276581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 146/289] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:09 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:09.326269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:09.327073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:09.335437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.335437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.335437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.337963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.338703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.339531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.540015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:09.550711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-190d9f88-378e-446c-bf91-d1d5e8c97d80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1503 microversion: 2.1 time: 0.228299 Sep 13 13:07:09.575260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6236cf68-07d0-49c4-8525-aaa879b94690"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:09.579589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:09.585681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 144/290] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:09 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:09.587884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.588387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.588825 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.589788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.590231 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.590831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.620723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 while it is in vm_state rescued Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Request method failure captured: Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/os-volume_attachments HTTP/1.1 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 74 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIASKZPtsIVlBDGq0ZWz3eFJS9tbLg_35fH1gurhTIAWQfK20jXGlxDguI8j7D_XlJMoUcCS1Swki_Kfq8g52gAEshJFAnSI91fMfuA2Qkpq4ha-xsqjszQs2XPOaRI0mePWSIU7GA1aBGb9s283gH_H8JCgOnAxtZkAfEGK8RXJIXw Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:07:09.622590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c15624f4312f49bb85a7a086c291d157", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 8c688fff323943b3bbcbb0569d974d0a Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {"volumeAttachment": {"volumeId": "6236cf68-07d0-49c4-8525-aaa879b94690"}} Sep 13 13:07:09.623901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Cannot 'attach_volume' instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 while it is in vm_state rescued Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'server_id': '4e8e228d-cd12-415d-be09-a5a49b6f72c7', 'body': {'volumeAttachment': {'volumeId': '6236cf68-07d0-49c4-8525-aaa879b94690'}}} Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:07:09.624756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 while it is in vm_state rescued Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:07:09.626238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 while it is in vm_state rescued Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Returning 409 to user: Cannot 'attach_volume' instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 while it is in vm_state rescued {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:07:09.627523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a3cdceee-fbd7-457e-935c-740106b7e2e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053995 Sep 13 13:07:09.628915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 147/291] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:07:09 2022] POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 13:07:09.636172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:09.642812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:09.653704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.654573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.655195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.656101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.658107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.659933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.938481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f89a16cf-0c80-40f7-bd8b-37f973bbfc09 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/action" status: 202 len: 0 microversion: 2.1 time: 0.304005 Sep 13 13:07:09.938481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 145/292] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:07:09 2022] POST /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:07:09.944623 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:09.945237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:09.953101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.953894 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.954338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:09.955044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:09.955494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:09.955915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:10.117887 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:10.119872 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:10.140782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:10.143850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:10.144494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:10.145420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:10.146115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:10.146953 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:10.256633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:10.266846 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af33069c-3dcb-4755-978b-4cd61d4168ed tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1511 microversion: 2.1 time: 0.327310 Sep 13 13:07:10.267407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 148/293] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:09 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:10.300570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:10.301622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:10.320261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:10.321936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:10.322608 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:10.323566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:10.324189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:10.324785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:10.436026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:10.444657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:10.446842 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:10.448092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ac51ab66-1f4a-4343-9bec-c98bb8a2227d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.334736 Sep 13 13:07:10.448726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 146/294] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:10 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:10.571280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:10.579721 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9873aa79-d407-401d-b767-667307007891 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.282864 Sep 13 13:07:10.580616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 149/295] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:10 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:11.293191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:11.294082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:11.301261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.301781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.302484 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.303265 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.305382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.306702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.474838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:11.475858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:11.485945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.486458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.487002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.487726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.488193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.489571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.537650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:11.549167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dedd190d-5374-47b7-9390-8159a4184e97 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1511 microversion: 2.1 time: 0.260508 Sep 13 13:07:11.551810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 147/296] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:11 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:11.609180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:11.609839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:11.618422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.619101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.624085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.624085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:11.624085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:11.624085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:11.764081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:11.774305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:11.777633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:11.779536 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4fc2925e-29d8-40b0-a843-1445a858f176 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.308851 Sep 13 13:07:11.794373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 150/297] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:11 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:11.900790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:11.900790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2fce24ff-940f-4c0b-aafd-76f2381ec708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.298431 Sep 13 13:07:11.900790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 148/298] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:11 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:12.588924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:12.589634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:12.595792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.596601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.597249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:12.598040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.598754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.599189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:12.751933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:12.760579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8bfcb278-1883-47b4-a794-8e77cafdcaef tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1511 microversion: 2.1 time: 0.176911 Sep 13 13:07:12.761782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 151/299] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:12 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:12.807431 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:12.808768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:12.819491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.819995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.831769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:12.831769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.831769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.831769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:12.843999 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:12.924905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:12.925710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:12.967820 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.968492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.970948 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:12.970948 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:12.971706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:12.972398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:13.061286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:13.071772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:13.073642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:13.075154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0dee01a6-9db7-4fed-a0b3-6b76febe57fc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.272196 Sep 13 13:07:13.076125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 149/300] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:12 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:13.184866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:13.194744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc", "name": "network-vif-plugged", "status": "completed", "tag": "e42f6f1f-ed4b-41d3-a2b4-ba1b11365103"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:13.204821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88067026-40d4-4570-acd1-eddfa3cc8bb7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.285513 Sep 13 13:07:13.205405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 152/301] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:12 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:13.214218 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:13.215155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:13.215893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:13.241671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] Creating event network-vif-plugged:e42f6f1f-ed4b-41d3-a2b4-ba1b11365103 for instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc on hv-cinder-80135 Sep 13 13:07:13.252692 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8885e2b3-e01a-41df-8d1e-fe343a1412cd req-ef4288c0-bc26-466b-a29f-129cc316ed51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061426 Sep 13 13:07:13.253726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 150/302] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:07:13.784945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:13.785657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:13.792496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:13.792987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:13.793729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:13.794450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:13.795060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:13.795319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:13.954848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:13.962958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-21319b52-7ee3-40ae-9f49-fa40dfdb4af4 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1517 microversion: 2.1 time: 0.182130 Sep 13 13:07:13.963533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 153/303] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:13 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:14.102656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:14.103550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:14.110550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:14.116880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:14.119540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:14.123910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:14.124483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:14.124926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:14.240165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:14.240782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:14.254673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:14.257031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:14.258089 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:14.259031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:14.259628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:14.260406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:14.296961 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:14.305608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:14.307077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:14.308240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ce09cd8-6307-4e4f-a53e-8bebb196ed1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.211509 Sep 13 13:07:14.308789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 151/304] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:14 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:14.400819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:14.408494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7b608f6-c199-45d9-9ee6-3c9eae57d12c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.183300 Sep 13 13:07:14.409077 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 154/305] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:14 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:15.335485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:15.336963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:15.345430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:15.348073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:15.348542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:15.349349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:15.349937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:15.350333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:15.434575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:15.435907 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:15.437909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:15.443724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:15.444538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:15.445209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:15.447200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:15.448926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:15.449433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:15.580725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:15.589599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:15.591225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:15.592396 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6ee10700-a5a7-4ce1-9093-e81df14717b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.262387 Sep 13 13:07:15.592960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 152/306] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:15 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:15.617513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:15.625128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-abf078cb-1f08-4478-b221-02876a46c46c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1366 microversion: 2.1 time: 0.195783 Sep 13 13:07:15.625686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 155/307] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:15 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:15.749247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cb8df36c-bc94-420f-9bcd-faf390bf5732 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: .version_select at 0x7f1565234790>, body: {"keypair": {"name": "tempest-keypair-1508786306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0RGb6hBobRqNEXeqGX9VP/mRkOOPPAv9wXLUhvZqAsYDRR/xhGpzQSttSYxs08rz3sxvgaW9Ron+1xF/Jn+nj+ElhTLL217N4uJv0v3iy8ZaS6tAxfx6YsAoosa6zUZQ=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:15.767497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb8df36c-bc94-420f-9bcd-faf390bf5732 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for project c15624f4312f49bb85a7a086c291d157. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:07:15.772058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-cb8df36c-bc94-420f-9bcd-faf390bf5732 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for user 8c688fff323943b3bbcbb0569d974d0a and project c15624f4312f49bb85a7a086c291d157. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:07:15.887568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cb8df36c-bc94-420f-9bcd-faf390bf5732 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142172 Sep 13 13:07:15.888202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 153/308] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:07:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:16.132715 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:16.139221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.139710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.140533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.202819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 13:07:16.390944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f95ba4c7-10c3-4d92-a828-5f154af9b104 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action" status: 202 len: 0 microversion: 2.1 time: 0.261932 Sep 13 13:07:16.392463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 156/309] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:07:16 2022] POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:07:16.402978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:16.403866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:16.411238 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.411834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.412475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.413381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.413918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.414395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.569783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:16.578578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-805b69d5-b215-40b7-8066-6b7d6e1bc857 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.182626 Sep 13 13:07:16.579131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 154/310] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:16 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:16.621175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:16.622032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:16.629465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.629983 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.630422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.631117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.631566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.631983 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.654239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:16.655232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:16.655366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:16.661686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.662347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.662883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.663675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.664200 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.666084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.836229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:16.848444 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:16.854768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:16.854768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f1705514-e6d3-40b5-8e5d-631d4e71c2f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.236333 Sep 13 13:07:16.854768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 157/311] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:16 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:16.855959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:16.877366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d42c7350-0449-44a7-b6a5-b43b5d533a5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1556 microversion: 2.1 time: 0.230890 Sep 13 13:07:16.890067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 155/312] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:16 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:16.920601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:16.921725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:16.932811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.933679 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.934740 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:16.935972 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:16.936801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:16.937581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:17.068443 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-de10bc88-5401-4478-8643-fa630bd930a5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156514 Sep 13 13:07:17.069036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 158/313] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:07:16 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:17.606813 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:17.608311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:17.616084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:17.617145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:17.618036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:17.619180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:17.626706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:17.626706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:17.898256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:17.899497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:17.907251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:17.907866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:17.908498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:17.909460 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:17.910009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:17.910626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:17.969089 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:17.978392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-09713f2c-db61-4b29-b4a3-7114f5960a35 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.377653 Sep 13 13:07:17.978972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 156/314] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:17 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:18.137417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:18.144754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:18.146504 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:18.148015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0cd1257-be22-44f4-a7c5-30a18a231af9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.255507 Sep 13 13:07:18.166222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 159/315] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:17 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:18.567269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc", "tag": "e42f6f1f-ed4b-41d3-a2b4-ba1b11365103"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:18.575040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:18.578850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:18.579394 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:18.579878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:18.597136 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] Creating event network-changed:e42f6f1f-ed4b-41d3-a2b4-ba1b11365103 for instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc on hv-cinder-80135 Sep 13 13:07:18.603055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6f696e28-1844-4fb7-af03-44aa010ca9fd req-02b33ac3-5f1b-49cc-a994-caf728879442 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045685 Sep 13 13:07:18.604101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-340672542", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2a92aa9-ba65-41c7-9fbf-76e49b2ae7c7"}], "security_groups": [{"name": "tempest-securitygroup--1771846920"}], "key_name": "tempest-keypair-1508786306", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:18.605067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 157/316] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:18.803988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] validate_networks() for [('d2a92aa9-ba65-41c7-9fbf-76e49b2ae7c7', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:07:19.004348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:19.005633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:19.012867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.013658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.014276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.015248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.016512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.017023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.383857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:19.392658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91ff5afa-a341-4cfa-ba9a-add8fa2e6c70 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.393919 Sep 13 13:07:19.413832 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 158/317] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:18 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:19.421515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:19.422527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:19.428801 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.429296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.430684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.431730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.433257 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.433257 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.679945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:07:19.682038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:07:19.682747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:07:19.683752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:07:19.684429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:07:19.698812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.700985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.701726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.704497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:19.705225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:19.705957 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:19.732223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:07:19.733564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:19.741767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Getting quotas for user 8c688fff323943b3bbcbb0569d974d0a and project c15624f4312f49bb85a7a086c291d157. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:07:19.762718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:07:19.763410 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:19.766254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:19.767978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a8f90da-91ff-4b38-9ee0-44d74b6037b5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.350774 Sep 13 13:07:19.770600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:07:19.770756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 159/318] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:19 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:19.931823 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ca04cfdd-c6f7-49af-8ffa-6167774113f6 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.334210 Sep 13 13:07:19.932571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 160/319] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:07:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:07:19.943629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4bee17df-ff92-442a-986c-a16944e98a0c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:19.944231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4bee17df-ff92-442a-986c-a16944e98a0c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:20.015101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4bee17df-ff92-442a-986c-a16944e98a0c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:20.022660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4bee17df-ff92-442a-986c-a16944e98a0c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1245 microversion: 2.1 time: 0.082798 Sep 13 13:07:20.023281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 160/320] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:19 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:20.420346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:20.421134 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:20.428801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:20.429301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:20.430661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:20.431505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:20.431963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:20.432488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:20.573344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:20.583297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afec9e06-778d-423d-abe4-c991709c6151 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.167402 Sep 13 13:07:20.584426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 161/321] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:20 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:20.795159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:20.795682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:20.802758 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:20.803247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:20.803682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:20.804376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:20.805046 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:20.805614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:20.984120 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:20.991671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "name": "network-vif-plugged", "status": "completed", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:21.002342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:21.003205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:21.003333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:21.004076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:21.005649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:21.006869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5f06fee-9799-42be-a90e-e1953407fc0f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.216055 Sep 13 13:07:21.007425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 161/322] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:20 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:21.016969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] Creating event network-vif-plugged:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:07:21.022452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-669315e9-ef6f-495d-86ea-023b7c3f5f59 req-69bdb0ee-f064-43ee-b818-31061b6dee06 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034786 Sep 13 13:07:21.023306 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 162/323] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:07:21.048513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:21.049054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:21.056594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:21.057085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:21.057612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:21.058666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:21.059118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:21.059809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:21.145144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:21.159777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9ce03a69-c864-43d7-bc2f-755878b59027 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1249 microversion: 2.1 time: 0.115027 Sep 13 13:07:21.160418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 162/324] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:21 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:21.609624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:21.610432 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:21.616936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:21.618721 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:21.619172 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:21.619878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:21.620368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:21.620792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:21.764862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:21.773060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a0a225a7-f066-40f3-b26a-a08e312a3f84 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.168442 Sep 13 13:07:21.775237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 163/325] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:21 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:22.034551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:22.035161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:22.042857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.043644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.044084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.044780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.045242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.045670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.183637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:22.184256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:22.190712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.191197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.191632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.192120 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:22.192640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.192753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.193175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.201006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:22.204236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:22.204236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-137be389-1026-4fdb-883b-9f839a25b0a9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.173206 Sep 13 13:07:22.204441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 163/326] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:22 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:22.258403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:22.265952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00fa40f0-ea17-4def-b5bc-69d03f871ab1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1297 microversion: 2.1 time: 0.087271 Sep 13 13:07:22.266515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 164/327] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:22 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:22.799191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:22.799780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:22.806368 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.806869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.807460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.808166 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:22.808627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:22.809053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:22.962895 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:22.971673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8089dcfb-e5c4-450a-a6a1-930a03d8125d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.176321 Sep 13 13:07:22.972373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 164/328] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:22 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:23.229267 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:23.229913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:23.236351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:23.236838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:23.237278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:23.237998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:23.238452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:23.239021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:23.291362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:23.291976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:23.298606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:23.299103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:23.299543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:23.300286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:23.300746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:23.301170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:23.378968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:23.389332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c56dbd4f-dfb8-44b8-9459-3189a5d3bc46 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1297 microversion: 2.1 time: 0.101856 Sep 13 13:07:23.390724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 165/329] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:23 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:23.410218 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:23.418595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:23.421802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:23.421802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9a2bed0f-2d58-4266-aae6-1bfcb6d2dc27 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.195906 Sep 13 13:07:23.421802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 165/330] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:23 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:23.995490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:23.996239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:24.002393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.002886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.003326 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.006069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.006069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.006069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.156397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:24.165850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b093508b-c196-4fbc-aa1e-31055c6d0a49 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.174933 Sep 13 13:07:24.166418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 166/331] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:23 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:24.412339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:24.413008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:24.420576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.421066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.421507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.422366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.424908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.424908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.450462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:24.451724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:24.468709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.470216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.471142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.472140 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:24.472617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:24.473045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:24.497621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:24.505972 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f8b2328a-fb32-4452-b8df-c9a3f17582b2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1297 microversion: 2.1 time: 0.097292 Sep 13 13:07:24.506552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 166/332] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:24 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:24.639595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:24.649567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:24.651322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:24.652656 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2251279-1611-42bc-98c8-14a7671b1ef2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1746 microversion: 2.20 time: 0.208551 Sep 13 13:07:24.653212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 167/333] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:24 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:25.190422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:25.192121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:25.211836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.212745 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.213337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.214210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.214810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.216036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.529909 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:25.531215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:25.538230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.539113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.539744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.540625 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.541243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.541854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.636322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:25.650448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-64307459-113a-4656-b588-7f851ebad02e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1315 microversion: 2.1 time: 0.124475 Sep 13 13:07:25.651732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 168/334] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:25 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1315 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:25.679977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:25.680933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:25.687784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.692061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.692061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.692061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:25.692061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:25.692621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:25.727144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:25.740262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:25.752552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-64dbbf00-989c-412a-8e3d-08f1a26507c1 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.567310 Sep 13 13:07:25.757998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 167/335] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:25 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:25.942853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:25.964803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:25.966294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:25.967884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e33d94d2-8a21-4073-82a9-048c644b7d1b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.292577 Sep 13 13:07:25.968515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 169/336] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:25 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:26.966814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:26.966814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:26.966814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:26.966814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:26.967555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:26.967555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:26.967555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:26.967555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:26.967852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:26.967852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:26.967852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:26.967852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:26.968536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:26.968536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:26.968536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:26.968536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:26.968887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:26.976584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c070fab0-dd50-485f-9f5f-0bfc20418fc5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.303499 Sep 13 13:07:26.977177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 168/337] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:26 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:27.004597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:27.011493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:27.019294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:27.019870 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:27.020507 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:27.021560 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:27.022383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:27.023874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:27.030304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:27.040662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-988051b2-0bf1-4bc6-b66a-fc7e5d85acf5 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.267840 Sep 13 13:07:27.041550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 170/338] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:26 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:27.224312 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:27.256099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:27.258243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:27.259985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4a49fba-57fb-4226-8efd-7afab67bdf08 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.262794 Sep 13 13:07:27.268862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 169/339] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:26 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:28.028829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:28.028829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:28.051070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.051070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.054793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.055820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.056905 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.058049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.075222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:28.076486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:28.099791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.099791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.099791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.099791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.100100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.100100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.378854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:28.396967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79c90b0f-3d97-4ca1-a990-f0d49132d815 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.381011 Sep 13 13:07:28.419130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 171/340] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:28 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:28.419130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:28.419130 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:28.424947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.427070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.427959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.433983 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:28.442613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.443118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.444092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.448154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8796f06-741a-4b8c-85fa-08980f32e66a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.383505 Sep 13 13:07:28.457936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 170/341] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:28 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:28.618939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:28.637897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:28.644154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:28.647519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:28.665911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] Creating event network-changed:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:07:28.672378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-0656bf08-e700-4644-98ef-5bc7144fa469 req-cbac691c-e09f-4de4-9552-cc0f22942767 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059820 Sep 13 13:07:28.673193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 171/342] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:28.693835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:28.707249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:28.708742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:28.710018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8d52a7f1-05fa-4a33-a076-fa120487dcea tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.310664 Sep 13 13:07:28.712165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 172/343] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:28 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:29.425686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:29.426412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:29.433136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.433621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.434088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.434780 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.435236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.435660 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.471333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:29.471930 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:29.478492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.478964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.479404 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.480081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.480532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.480955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.672357 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:29.680713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4358ce47-e3e7-46f3-8234-4bbd8f9d570f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.259522 Sep 13 13:07:29.681420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 172/344] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:29 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:29.699436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:29.707736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0cbcf1ff-8020-4272-aa4c-a94edc676fce tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.240295 Sep 13 13:07:29.708299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 173/345] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:29 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:29.742939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:29.743925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:29.749169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:29.751266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.751753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.752184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.752917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:29.753451 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:29.754024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:29.754463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:29.908941 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:29.919843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:29.921764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:29.923265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00b1cc3e-bc54-4167-9cd5-b4dc82f76536 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.184780 Sep 13 13:07:29.924853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 173/346] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:29 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:30.703703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:30.704930 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:30.706857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:30.713087 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.713592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.714034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:30.722487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.722487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.722487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:30.733014 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:30.733628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:30.739758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.740220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.740681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:30.741366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.742470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.742891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:30.951012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:30.954692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:30.960482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-544b75db-11ee-4a46-bcf6-2432382fe37b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.260469 Sep 13 13:07:30.961677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 174/347] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:30 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:30.967390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:30.968199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:30.977512 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15f829c2-62ae-4afc-a8cd-85cf817a2ed7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.249068 Sep 13 13:07:30.978207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.978351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 174/348] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:30 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:30.978977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.979796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:30.980666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:30.981399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:30.982033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:31.136547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:31.146908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:31.149566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:31.151279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f78bcf67-3975-42f7-b3fa-c299d2b7623d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.188128 Sep 13 13:07:31.152304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 175/349] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:30 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:31.983069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:31.983746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:31.990654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:31.991352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:31.992356 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:31.993249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:31.994043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:31.994685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:32.003005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:32.003703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:32.014192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:32.015348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:32.015348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:32.015809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:32.016262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:32.018407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:32.313581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:32.316899 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:32.325644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-314aa9b8-cad9-4958-bbf3-5ee28893deed tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.326583 Sep 13 13:07:32.326608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 176/350] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:31 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:32.327057 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0272f5d8-df3d-41cc-bb70-567aca83a874 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.347844 Sep 13 13:07:32.327903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 175/351] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:31 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:32.347511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:32.348356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:32.355536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:32.356268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:32.356871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:32.357718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:32.358382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:32.358987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:32.528097 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:32.536965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:32.538734 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:32.540149 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-142198c5-326f-4be5-a339-8c8e22add4b4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.212299 Sep 13 13:07:32.540744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 177/352] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:32 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:33.350003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:33.350634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:33.355452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:33.356323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:33.358570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.359074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.359493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.360185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.360633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.361052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.363797 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.364299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.364731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.366217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.366736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.367556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.380588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:33.592970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:33.602327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df8c3e13-caff-4cfa-b1d4-6c0df10bfd31 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.256130 Sep 13 13:07:33.603146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 176/353] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:33 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:33.607864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:33.608793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:33.615341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:33.624802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.627345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b595517c-40d4-424f-b80c-8f31edfa0586 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.278140 Sep 13 13:07:33.627917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 178/354] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:33 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:33.629264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.629264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.629587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:33.630600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:33.631176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:33.802973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:33.811940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:33.813357 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:33.814586 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1a2440c6-1068-470a-bb1b-c6b63481aaf6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.210341 Sep 13 13:07:33.815131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 177/355] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:33 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:34.625643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:34.626293 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:34.644371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.645079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.645711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:34.646640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.647422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.648330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:34.658583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:34.661931 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:34.667558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.668582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.669178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:34.670166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.670785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.671370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:34.900131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:34.908813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f28d7fda-1821-44e8-bae8-e16ce30a61af tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.256317 Sep 13 13:07:34.912678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:34.916808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 178/356] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:34 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:34.923593 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b32e1baf-7316-47d1-bb4f-e8473282caf7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.301683 Sep 13 13:07:34.927249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:34.942110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 179/357] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:34 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:34.942950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:34.951478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.952200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.952640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:34.953344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:34.953995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:34.954422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:35.088237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:35.096459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:35.097918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:35.099074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-81207e06-cd07-4b32-a47e-ddcf65a23ef8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.177516 Sep 13 13:07:35.099634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 179/358] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:34 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:35.940412 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:35.941097 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:35.949309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:35.950104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:35.956364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:35.957611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:35.963929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:35.966310 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:35.967316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:35.968053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:35.968699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:35.970871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:35.971528 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:35.972441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:35.976725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:35.977984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:36.184455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:36.189141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:36.201099 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-218fd510-5161-42fc-b3de-34383b1f666e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.264798 Sep 13 13:07:36.201688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 180/359] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:35 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:36.203981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42813cf9-9ca9-4998-a346-9c5b6cd8cdd9 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.252161 Sep 13 13:07:36.206803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:36.207636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:36.221786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 180/360] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:35 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:36.229382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:36.229918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:36.230356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:36.231081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:36.231534 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:36.231961 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:36.404479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:36.412726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:36.415057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:36.416208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d1e56bcb-6ee2-4f16-b6bf-69bd448eb165 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.213380 Sep 13 13:07:36.416760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 181/361] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:36 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:37.225227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:37.226636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:37.233268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.234111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.234717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.235613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.236230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.236812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.239855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:37.240514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:37.251219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.251723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.254509 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.261284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.261950 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.262477 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.474015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:37.479268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:37.485909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a046079e-6729-464c-8a89-8c06184a4ac9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.264391 Sep 13 13:07:37.486695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 181/362] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:37 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:37.491816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:37.492670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:37.499649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.500289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.501060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.502156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:37.502833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:37.503327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:37.509256 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-45716779-f161-494b-8a1f-f91cf7511b99 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1724 microversion: 2.1 time: 0.276193 Sep 13 13:07:37.514639 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 182/363] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:37 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:37.662964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:37.672594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:37.674723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:37.675809 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d24a09a-bf26-4d2a-a7a7-b5bdbf43cfd3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.187994 Sep 13 13:07:37.676687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 182/364] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:37 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:38.510636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:38.517085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:38.517984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.518478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.518922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.519631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.520079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.520508 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.536325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:38.536939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:38.544257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.544745 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.545208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.545978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.546649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.547076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.721775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:38.737573 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:38.737782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cad89466-c2aa-417d-b729-f9723ef11860 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.222836 Sep 13 13:07:38.737782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 183/365] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:38 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:38.737782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:38.738012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3d18c233-804e-46b4-9542-00a8fa015503 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1701 microversion: 2.1 time: 0.202658 Sep 13 13:07:38.738102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:38.738212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 183/366] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:38 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1701 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:38.741182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.741697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.742167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.742853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.743303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.743726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.758988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:38.764757 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.765247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.765686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.789476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Going to try to start instance {{(pid=121102) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 13:07:38.873148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:38.881262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:38.883290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:38.884440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-14c7a6e6-796a-4a8e-a06a-0bcf51d4cfcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.153337 Sep 13 13:07:38.884988 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 184/367] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:38 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:38.977492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87b54c4d-fee8-4721-a268-12e8834eb879 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action" status: 202 len: 0 microversion: 2.1 time: 0.223191 Sep 13 13:07:38.978120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 184/368] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:07:38 2022] POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:07:38.986203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:38.986851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:38.992798 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.993281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.993717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:38.994428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:38.994883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:38.995316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:39.123757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:39.125965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:39.133845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4f570ca-034a-46f4-a397-bbe98c431f18 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.151435 Sep 13 13:07:39.134419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 185/369] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:38 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:39.753299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:39.754032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:39.760149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:39.760634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:39.761072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:39.761775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:39.762236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:39.762662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:39.898932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:39.906629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f5725550-b375-4b05-a8d7-b047717d74b9 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.157938 Sep 13 13:07:39.907430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 185/370] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:39 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:39.910742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:39.911378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:39.918975 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:39.919457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:39.919888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:39.920571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:39.921023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:39.921441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:40.046290 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:40.054331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:40.055754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:40.056894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e7a0ccc0-59d5-4332-abff-29b45803de60 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.150541 Sep 13 13:07:40.057451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 186/371] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:39 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:40.159895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:40.160501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:40.166794 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:40.167274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:40.167961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:40.168638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:40.169150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:40.169577 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:40.300492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:40.308849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f68dae74-9241-4b2e-981f-03a517180894 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.152779 Sep 13 13:07:40.309416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 186/372] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:40 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:40.931009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:40.931654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:40.938123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:40.938570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:40.939075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:40.939807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:40.940260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:40.940702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:41.068474 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:41.076618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b645925-3a93-492f-9d12-311f39bc895b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.149987 Sep 13 13:07:41.077178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 187/373] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:40 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:41.082587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:41.083281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:41.089713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:41.090301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:41.090808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:41.091566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:41.092108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:41.092537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:41.331985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:41.332594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:41.339829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:41.340332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:41.340767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:41.341469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:41.341947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:41.342370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:41.563077 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:41.571622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:41.573065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:41.574285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b505735-8247-4c36-ba85-62743eb5c941 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1741 microversion: 2.20 time: 0.495724 Sep 13 13:07:41.574851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 187/374] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:41 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1741 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:41.644062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:41.652918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c8f3171-8f44-41d1-a5d7-c2bf032ef99e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.324924 Sep 13 13:07:41.653497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 188/375] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:41 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:42.099331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:42.099944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:42.106585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.107071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.107503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.108187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.108640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.109063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.235789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:42.244411 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-72db061b-c288-4edf-987a-c739bf9329ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.148887 Sep 13 13:07:42.244977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 188/376] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:42 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:42.600322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:42.601562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:42.607962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.608444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.608873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.609562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.610042 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.610490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.676549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:42.677181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:42.683685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.684179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.684611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.685298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:42.685775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:42.686192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:42.773604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:42.781833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:42.783291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:42.784447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-092a24b0-e4b9-40a0-b1a9-0e13350de855 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1723 microversion: 2.20 time: 0.187979 Sep 13 13:07:42.785035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 189/377] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:42 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:42.832441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:42.841501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb96d3f2-c49e-477c-9929-0eac16105581 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.168955 Sep 13 13:07:42.842091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 189/378] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:42 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:43.267228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:43.267841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:43.273908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.274396 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.274833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:43.275521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.275976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.276398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:43.405629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:43.413190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b627b3de-4545-4eda-80c0-391d4389042a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.149678 Sep 13 13:07:43.413760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 190/379] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:43 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:43.811905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:43.812511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:43.818897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.820039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.820545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:43.821152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.821603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.822055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:43.864719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:43.865341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:43.872398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.872944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.873387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:43.874115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:43.874605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:43.875033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:44.008085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:44.016218 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:44.017644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:44.018824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cf83a46-8ec6-4682-920e-aa27bf41664f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1723 microversion: 2.20 time: 0.210715 Sep 13 13:07:44.019382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 190/380] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:43 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:44.034935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:44.044054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a4ead17-f324-4222-a2ad-8802712ffb11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.183436 Sep 13 13:07:44.044617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 191/381] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:43 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:44.283113 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "name": "network-vif-plugged", "status": "completed", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:44.294854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:44.295342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:44.295798 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:44.308952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] Creating event network-vif-plugged:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:07:44.315052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8a2b46da-7e9e-4631-a45e-b462229890ee req-7bfe0876-3997-44ab-979e-1320aa3a5cf8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Sep 13 13:07:44.315852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 191/382] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:44.436251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:44.436869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:44.442827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:44.443310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:44.443746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:44.444538 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:44.445271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:44.445730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:44.576051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:44.587727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d046684-685c-4a3f-ae49-1f1bf73a6e21 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.151886 Sep 13 13:07:44.587727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 192/383] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:44 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:45.048545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:45.048545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:45.054635 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.055143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.055588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.056367 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.056780 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.057199 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.068794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:45.071903 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:45.077057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.077515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.077983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.078879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.079425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.079866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.343772 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:45.346120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:45.349451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:45.355267 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:45.356758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:45.358246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-576f5e9a-9faa-4aa7-8d8a-98ce5931e640 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1723 microversion: 2.20 time: 0.316700 Sep 13 13:07:45.359322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 192/384] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:45 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:45.360984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42b1b9ac-31cd-4efc-ac49-f0130500eb75 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1710 microversion: 2.1 time: 0.296217 Sep 13 13:07:45.370330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 193/385] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:45 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1710 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:45.432314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-536272739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-474635815", "security_groups": [{"name": "tempest-secgroup-smoke-1414851579"}], "networks": [{"uuid": "19cd7ffa-2cb0-41ee-9a8e-ce82bacd4ce1"}], "block_device_mapping_v2": [{"uuid": "8af28f58-1fd9-4af6-aa0c-a2db12b73553", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:45.548286 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] validate_networks() for [('19cd7ffa-2cb0-41ee-9a8e-ce82bacd4ce1', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:07:45.608968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:45.609871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:45.615785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.616428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.616866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.617565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.618045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.618477 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.807876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:45.815812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f87c012-1ba0-4aaf-b300-9a33336be061 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.210679 Sep 13 13:07:45.816383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 194/386] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:45 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:45.984289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:07:45.984710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:07:45.985177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:07:45.985583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:07:45.986025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:07:45.996064 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.996610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.996963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:45.997940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:45.998398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:45.998986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.016881 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Getting quotas for project 9788b5b66a0c452cb39b263ca30284e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:07:46.019102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:46.021470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Getting quotas for user 4690104f5bea480d87b7c43488182441 and project 9788b5b66a0c452cb39b263ca30284e0. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:07:46.078727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:07:46.080831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8af28f58-1fd9-4af6-aa0c-a2db12b73553',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:07:46.385065 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:46.385714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:46.392545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.392924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.393362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.394105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.394557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.394985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.498940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-98184213-4ba6-498e-a02d-47e12532651d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070653 Sep 13 13:07:46.499588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 193/387] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:07:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:07:46.504317 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:46.505116 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:46.512585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.513898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.513898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.514377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.515055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.515214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.538932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.548718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-869597eb-9d13-40dc-8e83-a90435686c88 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1714 microversion: 2.1 time: 0.167935 Sep 13 13:07:46.549607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 195/388] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:46 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:46.554460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6be17c72-38c9-4a8b-a253-a0ee158f9267 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:46.555245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6be17c72-38c9-4a8b-a253-a0ee158f9267 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:46.645634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6be17c72-38c9-4a8b-a253-a0ee158f9267 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.657254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6be17c72-38c9-4a8b-a253-a0ee158f9267 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1087 microversion: 2.1 time: 0.106314 Sep 13 13:07:46.658438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 196/389] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:46 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1087 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:46.719171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.727973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.729383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.730559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-79ba4998-cec3-4468-b283-3c50ae450c50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1723 microversion: 2.20 time: 0.229910 Sep 13 13:07:46.739416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 194/390] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:46 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:46.841456 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:46.842138 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:46.848531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.849021 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.849461 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.850215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:46.851308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:46.851739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:46.982062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:46.989693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7e40c549-d68b-4972-a7c6-28d6fd08b91a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.152048 Sep 13 13:07:46.990278 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 197/391] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:46 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:47.681389 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:47.682026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:47.691244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:47.691728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:47.692160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:47.692852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:47.693412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:47.693840 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:47.761925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:47.761925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:47.762493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:47.766426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:47.766926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:47.767517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:47.768237 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:47.768695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:47.769117 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:47.770023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dd4cb357-e4ce-402b-ae0e-0e3739aba0a4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1137 microversion: 2.1 time: 0.093551 Sep 13 13:07:47.771109 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 195/392] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:47 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:47.919763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:47.927814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:47.929531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:47.930915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa1f0fff-64d4-4f86-8bb4-46d3ea9725df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1723 microversion: 2.20 time: 0.178390 Sep 13 13:07:47.931564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 198/393] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:47 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:48.013334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:48.013898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:48.019696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.020183 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.020606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.021319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.021791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.022220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.154171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:48.164832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bbad00ad-19c6-4780-847d-d0ff5c72568a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1371 microversion: 2.1 time: 0.155379 Sep 13 13:07:48.165659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 196/394] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:48 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:48.193055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "name": "network-vif-unplugged", "status": "completed", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:48.203732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.204221 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.204658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.215693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] Creating event network-vif-unplugged:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:07:48.220813 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f147e66a-3183-4f20-9e22-06bc87b15468 req-db46dc1e-d0cd-4845-81e6-1e2b50f9913f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031950 Sep 13 13:07:48.224752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 199/395] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:48.793466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:48.794017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:48.800548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.801058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.801516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.802512 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.802847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.803272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.872682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:48.880331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1d621369-e338-48b4-85e4-e4d1fcc97cd6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1129 microversion: 2.1 time: 0.091134 Sep 13 13:07:48.880880 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 197/396] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:48 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1129 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:48.956900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:48.957612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:48.965113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.965603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.966077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:48.966783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:48.967245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:48.967681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.097549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:49.106974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:49.108412 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:49.109595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3299cb93-459d-4fb5-9f2b-0246192b2dcc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1726 microversion: 2.20 time: 0.156929 Sep 13 13:07:49.110209 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 200/397] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:48 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:49.135774 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "489d49cc-aa80-4ff0-b9c4-22d234cbc41b"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:49.138272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:49.144269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.144746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.145245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.145957 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.146405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.146825 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.188420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:49.189041 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:49.196335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.200512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.200512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.200512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.200512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.200946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.331657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:49.340156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a9ba30b-0220-4ff7-8e60-947a30a56a0b tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1565 microversion: 2.1 time: 0.155489 Sep 13 13:07:49.340706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 201/398] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:49 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:49.362724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:49.363430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:49.370053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.370614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.371195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.372077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.372539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.382252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.451423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf690c78-e350-4c99-9020-72127cc3959f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092499 Sep 13 13:07:49.452061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 202/399] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:07:49 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:07:49.907017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:49.907628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:49.909575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=96 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:49.915156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.915653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.916221 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.916921 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:49.917699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:49.918344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:49.980868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:49.988760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2f347a35-eae8-42ff-b42c-85d6bd87e7d0 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1129 microversion: 2.1 time: 0.085729 Sep 13 13:07:49.989305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 203/400] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:49 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1129 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:50.299462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2bbfa336-f1c8-41a6-9147-f00b3d682aee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.168431 Sep 13 13:07:50.306008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 198/401] 10.222.0.72 () {62 vars in 1364 bytes} [Tue Sep 13 13:07:49 2022] POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments => generated 188 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 13:07:50.453669 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:50.454285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:50.461334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:50.462133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:50.462567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:50.463330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:50.463720 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:50.464141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:50.479001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:50.516897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 13:07:50.577526 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:50.589867 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:50.590353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:50.590784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:50.605121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] Creating event network-changed:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:07:50.610985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-9f1c0e15-5cf3-4ac4-8b0d-b79d24c910ca req-f1bd1905-7aab-497d-b0ca-514d9bd9881d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036291 Sep 13 13:07:50.610985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 199/402] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:50.900120 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-678cb8b7-1249-421c-adbe-4a3cf5c2d592 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/action" status: 202 len: 0 microversion: 2.20 time: 0.450192 Sep 13 13:07:50.906282 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 204/403] 10.222.0.72 () {62 vars in 1319 bytes} [Tue Sep 13 13:07:50 2022] POST /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:07:50.915122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:50.915920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:50.927334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:50.928283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:50.931757 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:50.933290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:50.934073 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:50.934909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:51.013213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:51.013860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:51.019863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:51.020607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:51.021038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:51.021994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:51.023072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:51.023572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:51.127938 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:51.136756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:51.137592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d9243d1-d1ea-427b-b244-6ed789770d2c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1185 microversion: 2.1 time: 0.128111 Sep 13 13:07:51.141095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 205/404] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:51 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:07:51.160202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:51.162178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:51.164888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c457125-170b-43fd-9e24-78b2291c20eb tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1752 microversion: 2.20 time: 0.256627 Sep 13 13:07:51.165794 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 200/405] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:50 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:52.168285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:52.168908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:52.180531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:52.181389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:52.182067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:52.183015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:52.184071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:52.184717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:52.191940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:52.193267 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:52.215335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:52.216150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:52.216792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:52.217861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:52.218537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:52.219154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:52.342710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:52.351471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-11c3ba05-e274-481c-8528-28ebfd4d8e11 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1203 microversion: 2.1 time: 0.190213 Sep 13 13:07:52.353781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 206/406] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:52 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:52.530739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:52.540783 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:52.544575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:52.544575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d43f0e1-906e-49ac-bbaa-cb0fefb74e85 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1752 microversion: 2.20 time: 0.355747 Sep 13 13:07:52.544575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 201/407] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:52 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:53.379231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:53.380012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:53.388029 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:53.389385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:53.389385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:53.390494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:53.391286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:53.391882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:53.570580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:53.571192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:53.578027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:53.578515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:53.578952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:53.580062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:53.580830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:53.581818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:53.707286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:53.716213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bdb55f62-cc27-4380-8826-7217442915e8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1271 microversion: 2.1 time: 0.341191 Sep 13 13:07:53.717258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 207/408] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:53 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:53.829832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:53.838749 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:53.840213 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:53.841370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7c96f6d7-9815-478c-8e28-c4528485d57d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1754 microversion: 2.20 time: 0.274909 Sep 13 13:07:53.842121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 202/409] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:53 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1754 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:54.265479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:07:54.277550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:54.278386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:54.279095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:54.293381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] Creating event network-changed:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:07:54.299433 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ac0c7690-bef7-4080-bbbc-4d37f7273338 req-e696d545-ffd5-4edb-a2db-fb7b373bd2fb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038300 Sep 13 13:07:54.300125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 208/410] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:07:54.739102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:54.739818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:54.747044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:54.747602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:54.748039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:54.748746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:54.749200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:54.749645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:54.870827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:54.872270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:54.879617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:54.880304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:54.880743 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:54.882036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:54.882528 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:54.882952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:55.000663 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:55.009467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25accb42-d806-4594-a25c-d5dbdbf7ae73 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.274163 Sep 13 13:07:55.010078 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 203/411] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:54 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:55.123796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:55.133088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:55.134558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:55.135722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd31736f-c747-4f4b-bc04-67ea5249d84c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1754 microversion: 2.20 time: 0.271142 Sep 13 13:07:55.136283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 209/412] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:54 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1754 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:56.036859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:56.038139 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:56.040759 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:56.041407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:56.046408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:56.046890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:56.047321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:56.048035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:56.048483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:56.048899 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:56.163557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:56.164596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:56.171395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:56.171978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:56.172505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:56.173308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:56.173897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:56.174490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:56.310701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:56.318368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-87a93a80-19e1-4903-b6b0-698fca831781 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.285375 Sep 13 13:07:56.319194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 204/413] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:56 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:56.413967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:56.422922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:56.424361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:56.425516 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-501d54af-845b-40f0-aa1d-755521e5bfd5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.266844 Sep 13 13:07:56.426113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 210/414] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:56 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:57.340937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:57.341633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:57.348203 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:57.348738 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:57.349248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:57.350029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:57.351664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:57.351664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:57.452501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:57.454140 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:57.468706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:07:57.470934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:57.471444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:57.471913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:57.472775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:57.473268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:57.473697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:57.601495 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:57.610174 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e79424e0-661c-441e-a3d7-45177e248949 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.273000 Sep 13 13:07:57.611248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 205/415] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:57 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:57.692776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:57.757231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:57.757231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:57.757231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b07a019c-c20d-475b-a22f-b09f38ba15c7 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.265264 Sep 13 13:07:57.757700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 211/416] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:57 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:07:58.639140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:58.639746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:58.649122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:58.655537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:58.655537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:58.655537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:58.655537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:58.655880 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:58.739203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:58.739818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:58.752703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:58.753444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:58.754380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:58.755357 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:58.755811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:58.756412 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:58.844539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:58.854297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-29e23540-66f2-47c5-a605-9e0f0bd5e72c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.218951 Sep 13 13:07:58.855179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 206/417] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:58 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:07:58.928136 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:58.938121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:58.939586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:07:58.940751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-017cd20b-e676-401d-bfaa-9651e99c21f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.205523 Sep 13 13:07:58.941306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 212/418] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:58 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:07:59.878758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:59.879455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:59.887124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:59.887758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:59.888410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:59.889305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:59.889895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:59.890445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:59.966915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:07:59.968239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:07:59.977455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:59.980395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:59.980395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:07:59.980395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:07:59.980395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:07:59.980750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:00.119015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:00.127479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-597c3966-5d68-4414-9c8e-bee1a23153a9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.253037 Sep 13 13:08:00.128065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 207/419] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:07:59 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:00.170113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:00.179238 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:00.180832 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:00.182006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1d156d98-6cda-45e2-8385-df6ca34a1586 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.218941 Sep 13 13:08:00.182562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 213/420] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:07:59 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:01.153373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:01.155400 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:01.168427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:01.168427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:01.168427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:01.168427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:01.168871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:01.168871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:01.168871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:01.219739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:01.220799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:01.235837 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:01.238205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:01.238205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:01.238205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:01.238205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:01.238683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:01.398810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:01.408205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3208b046-c576-4fcd-a3f2-2a935c39a4fd tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.259114 Sep 13 13:08:01.408793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 208/421] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:01 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:01.439807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:01.451227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:01.452806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:01.454348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-81484b7d-a3e4-4d85-a2ad-1a5c94a89981 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.249962 Sep 13 13:08:01.460496 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 214/422] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:01 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:02.433467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:02.434389 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:02.440845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:02.441339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:02.441803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:02.442538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:02.442998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:02.443422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:02.485145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:02.485892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:02.493109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:02.494261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:02.494931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:02.495869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:02.496518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:02.497253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:02.647456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:02.656824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7281b20-2612-4bb5-b48f-297cbdb4a411 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.228070 Sep 13 13:08:02.657963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 209/423] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:02 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:02.677259 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:02.687677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:02.689046 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:02.690286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc6d42f4-0c33-48f6-8795-8b2ab6697cba tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.209313 Sep 13 13:08:02.690844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 215/424] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:02 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:03.682046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:03.683052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:03.689547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:03.690053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:03.690488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:03.691177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:03.691639 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:03.692050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:03.716067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:03.717418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:03.723857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:03.734000 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:03.734645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:03.735477 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:03.736029 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:03.741100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:03.887918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:03.895562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a77a92ab-27f5-43ca-8b65-940428ee669e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.217264 Sep 13 13:08:03.896358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 210/425] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:03 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:03.919561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:03.928735 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:03.933233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:03.935398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c62892c-9934-4516-82cf-3256eb04e8df tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.223176 Sep 13 13:08:03.935985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 216/426] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:03 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:04.920331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:04.920959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:04.927616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:04.928347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:04.928646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:04.930296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:04.930418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:04.932816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:04.961470 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:04.962858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:04.971374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:04.972214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:04.972900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:04.973890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:04.974574 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:04.975224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:05.133111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:05.142475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-42a143ee-c8f4-4976-9896-0e980d41267c tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.226002 Sep 13 13:08:05.143060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 211/427] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:04 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:05.162708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:05.172981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:05.174563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:05.178534 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-46dfe3de-0842-4fb7-a79d-0eb747de6c3a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.221153 Sep 13 13:08:05.180473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 217/428] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:04 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:06.167970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:06.169408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:06.176429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:06.177052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:06.177566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:06.178460 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:06.178998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:06.179588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:06.204940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:06.206440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:06.219670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:06.220262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:06.220940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:06.221659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:06.222155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:06.222581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:06.411794 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:06.421663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:06.421904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-aac70600-58b4-437a-9dcb-289d814d02e7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.259247 Sep 13 13:08:06.427908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 212/429] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:06 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:06.440577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:06.442695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:06.443916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d494c944-b8ec-40a4-8036-2494edbfd78b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.242846 Sep 13 13:08:06.444484 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 218/430] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:06 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:07.448752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:07.450093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:07.456959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:07.457453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:07.457967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:07.458768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:07.459227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:07.459655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:07.469836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:07.470452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:07.476776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:07.477263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:07.477699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:07.478415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:07.478900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:07.479331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:07.668716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:07.678370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-337bc0ba-07e2-45f9-abeb-a05eb83670c8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.235159 Sep 13 13:08:07.679878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 213/431] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:07 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:07.680023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:07.688907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:07.690447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:07.691725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b338255c-7938-4cef-8753-37cbd4b41c29 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.225760 Sep 13 13:08:07.692936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 219/432] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:07 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:08.702285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:08.702913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:08.709210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:08.709688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:08.710150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:08.711315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:08.711760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:08.712177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:08.719088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:08.719697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:08.727397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:08.727888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:08.728332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:08.729026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:08.729488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:08.729943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:08.907307 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:08.915849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08f11ce3-e385-456a-976d-3a40be2e02c4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.217564 Sep 13 13:08:08.916819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 214/433] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:08 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:08.924032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:08.926262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:08.939356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:08.939356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:08.939356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-17447f68-c65d-476c-b604-fb931e6f5151 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.223307 Sep 13 13:08:08.939651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 220/434] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:08 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:09.939597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:09.940181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:09.947175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:09.947665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:09.948107 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:09.948830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:09.949283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:09.949708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:09.964497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:09.965232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:09.972268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:09.972754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:09.973193 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:09.973925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:09.974383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:09.974807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:10.163341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:10.167501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:10.171493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e56fb57-55cb-4917-b254-c3a09c0c3758 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.235888 Sep 13 13:08:10.172062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 215/435] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:09 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:10.176014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:10.177441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:10.178617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7aa97ae1-03af-4030-9088-c31b3d0880ac tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.218491 Sep 13 13:08:10.179676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 221/436] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:09 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:11.194740 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:11.195350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:11.201765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:11.202261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:11.202699 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:11.203390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:11.203841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:11.204264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:11.204602 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:11.205191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:11.212236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:11.212717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:11.213153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:11.213870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:11.214322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:11.214745 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:11.400959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:11.403634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:11.409074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5a0309b9-aeff-44ad-b46a-d6f0e47ad8ef tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.218285 Sep 13 13:08:11.409645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 216/437] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:11 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:11.412175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:11.413697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:11.414956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d12a08d-bb2d-46a1-9e00-8f95b5a94b81 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.214183 Sep 13 13:08:11.415498 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 222/438] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:11 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:12.433071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:12.433716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:12.440315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:12.440816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:12.440994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:12.441223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:12.441492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:12.442209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:12.442670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:12.443092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:12.448183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:12.448676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:12.449118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:12.449848 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:12.450308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:12.450739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:12.639373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:12.643579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:12.647618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f543515a-fb36-4788-8ef4-f5e62d1c57bb tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.219041 Sep 13 13:08:12.648192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 217/439] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:12 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:12.654347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:12.655794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:12.656949 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c5b6b3ba-62b9-4b14-8ebd-07e5e444e3d5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.220572 Sep 13 13:08:12.657495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 223/440] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:12 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:13.672159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:13.672805 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:13.679160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:13.679646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:13.681149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:13.681492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:13.682027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:13.682451 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:13.683369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:13.684005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:13.690164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:13.690654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:13.691085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:13.693841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:13.693841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:13.693841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:13.889012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:13.892916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:13.896662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11908800-eaee-4610-9c8c-42c1ca7d0cf6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.228327 Sep 13 13:08:13.899711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 218/441] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:13 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:13.902475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:13.903921 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:13.905070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a6644b7-94aa-49d7-829d-71a9685e3139 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.226088 Sep 13 13:08:13.905618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 224/442] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:13 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:14.428262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "name": "network-vif-plugged", "status": "completed", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:14.437783 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.438258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.438687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.452196 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] Creating event network-vif-plugged:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:08:14.462765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-26692508-1e83-43d7-80bb-d2114bdee63a req-833f88e1-77bf-4f01-9ce6-5347dcbea42e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Sep 13 13:08:14.462765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 219/443] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:14.702638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:14.703174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:14.709622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.710145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.710612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.711931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.712509 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.712995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.736854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-56a09f72-e0a9-4eea-b02b-5da6529d337b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/ips" status: 200 len: 150 microversion: 2.1 time: 0.038044 Sep 13 13:08:14.737440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 225/444] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:08:14 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:14.750212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72ceebaf-1fdc-4442-a872-38aa50736b27"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:14.752713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:14.758964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.759446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.759882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.760570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.761050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.761476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.843122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/os-volume_attachments HTTP/1.1 Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 74 Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:08:14.845204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {"volumeAttachment": {"volumeId": "72ceebaf-1fdc-4442-a872-38aa50736b27"}} Sep 13 13:08:14.846797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'server_id': 'a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc', 'body': {'volumeAttachment': {'volumeId': '72ceebaf-1fdc-4442-a872-38aa50736b27'}}} Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:08:14.851164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:14.853245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 400 to user: Invalid volume: volume 72ceebaf-1fdc-4442-a872-38aa50736b27 is already attached to instances: 42476fd8-5bc5-47f9-8aa9-da3e3012656b {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d704cb57-079f-4cdf-979e-1f8ceff10259 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101094 Sep 13 13:08:14.854857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 220/445] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:08:14 2022] POST /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:08:14.856190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:14.856696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:14.863053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.863543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.864050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.864670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.865121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.865540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.892119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:08:14.923849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:14.924657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:14.932741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.933230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.933700 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:14.934413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:14.934924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:14.935272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:15.065026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:15.073136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2ffbd5a2-ceaf-4e3f-ac56-b9ad8a2f8ce6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.153275 Sep 13 13:08:15.077333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 221/446] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:14 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:15.078182 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:15.078807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:15.084352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:15.084827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:15.085257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:15.085983 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:15.086980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:15.087398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:15.204153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-de185808-ba31-4656-9d30-95b42455deac tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 204 len: 0 microversion: 2.1 time: 0.352171 Sep 13 13:08:15.204748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 226/447] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:08:14 2022] DELETE /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:08:15.214121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:15.214826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:15.220537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:15.220732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:15.221184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:15.221621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:15.222350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:15.222803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:15.223228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:15.229905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:15.231494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:15.232659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3eb503a6-141a-4296-9f63-beb54af11728 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.158022 Sep 13 13:08:15.233212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 222/448] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:15 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:15.353501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:15.361105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9acf13e-70ee-44d8-8376-80661338208a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.151834 Sep 13 13:08:15.361655 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 227/449] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:15 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:16.096037 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:16.096650 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:16.103585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.104094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.104529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.105209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.105658 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.106100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.237576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:16.246446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-09dd3949-f3af-41b5-9f83-a2f62a66bd16 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.154104 Sep 13 13:08:16.247094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 223/450] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:16 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:16.257674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:16.259528 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:16.266637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.267122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.267622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.268257 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.269160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.269160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.385867 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:16.386482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:16.389483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:16.392851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.393336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.393783 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.394650 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:16.395098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:16.396116 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:16.402752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:16.411204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:16.412627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:16.419750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2daf2717-8a9d-41d2-b928-870694278ab8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.159955 Sep 13 13:08:16.419750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 228/451] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:16 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:16.532127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:16.540395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-54fc7006-fc5f-48ab-8a6f-f120d6c8c371 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.159386 Sep 13 13:08:16.540956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 224/452] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:16 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:17.270093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:17.270701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:17.277863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.278354 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.278822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.279512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.279964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.280391 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.415469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:17.423426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9afc4627-f8d0-4d95-adde-8ae1246eb5d5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.157258 Sep 13 13:08:17.423990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 229/453] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:17 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:17.439518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:17.440130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:17.447105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.447584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.449105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.449105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.449105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.449525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.464846 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:17.564686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:17.565299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:17.572079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.572570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.573008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.573712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:17.574175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:17.574601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:17.578356 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:17.590053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:17.591768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:17.592930 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e530d73-d626-4c45-b6db-037b2b4e5ee0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.157278 Sep 13 13:08:17.593669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 225/454] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:17 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:17.704272 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:17.712497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c2ef4e3-aa84-4f6d-b533-5226bd9157f9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.151742 Sep 13 13:08:17.713059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 230/455] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:17 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:18.446184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:18.446787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:18.453168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.453646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.454114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.454793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.455238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.455654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.590149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:18.597854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-054e7a9b-ef5b-4ae7-b372-be217271ae22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.155449 Sep 13 13:08:18.598483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 226/456] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:18 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:18.618371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:18.619102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:18.625581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.627224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.627224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.627224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.627618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.628039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.735878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:18.736486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:18.742421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.743079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.743522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.744214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:18.744663 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:18.745080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:18.754962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:18.764054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:18.765514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:18.766696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1da0b38d-ddbc-44a5-9606-707d660a098a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.152553 Sep 13 13:08:18.767251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 231/457] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:18 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:18.877249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:18.886029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1ab2bb21-4ce9-4d8d-9515-4f02a34cdf4b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.154146 Sep 13 13:08:18.886716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 227/458] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:18 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:19.622585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:19.623192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:19.629211 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.629696 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.630157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.630844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.631296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.631719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.758688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:19.766372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c17313a-820f-4d74-9ffc-7ab2854fc395 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.147556 Sep 13 13:08:19.766932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 232/459] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:19 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:19.794604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:19.795215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:19.801514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.802030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.802475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.803158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.803616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.804037 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.911611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:19.912181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:19.918923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.919420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.919861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.920554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:19.921039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:19.921469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:19.939365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:19.948029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:19.949496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:19.950740 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-25609782-aa88-4339-a43a-c88f4b9ea5e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.162339 Sep 13 13:08:19.951295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 228/460] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:19 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:20.051107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:20.059341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-302898d0-2b32-406f-b663-680f132f3af0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.151572 Sep 13 13:08:20.059901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 233/461] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:19 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:20.788360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:20.789051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:20.795456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:20.795995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:20.796349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:20.797030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:20.797478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:20.797932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:20.925911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:20.937806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f194c95e-1341-49e7-a835-c665a7170bea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.149805 Sep 13 13:08:20.937806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 229/462] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:20 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:20.977819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:20.978445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:20.980881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:20.985579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:20.986112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:20.986558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:20.987257 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:20.987716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:20.988146 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:21.083385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:21.083999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:21.089885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:21.090358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:21.090788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:21.091472 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:21.091919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:21.092335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:21.121519 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:21.130169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:21.131599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:21.132916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-112fa6e2-7df1-4d5e-ba87-e4788cdc3cc1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.159771 Sep 13 13:08:21.133577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 234/463] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:20 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:21.221482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:21.229657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a6feedf-282e-4815-885a-efd28cb3d196 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.150086 Sep 13 13:08:21.230250 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 230/464] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:21 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:21.958124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:21.958837 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:21.965295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:21.965806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:21.966249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:21.966931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:21.967382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:21.968048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:22.097652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:22.105510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efe4457c-e53c-466d-899c-0c1e46818f6b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.151202 Sep 13 13:08:22.106109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 235/465] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:21 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:22.160146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:22.160751 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:22.169156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:22.169633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:22.170085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:22.170796 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:22.171239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:22.171655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:22.253829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:22.254441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:22.261207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:22.261699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:22.262153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:22.262851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:22.263295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:22.263717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:22.267689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:22.311581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:22.320764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:22.322436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:22.323595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e6e02b0e-5c38-41ee-a0fb-578fb58073f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.167246 Sep 13 13:08:22.324158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 231/466] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:22 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:22.393052 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:22.400779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c53ca0d-21c4-4d48-8d00-1f2caf3fc9f6 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.150833 Sep 13 13:08:22.401354 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 236/467] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:22 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:23.128806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:23.129412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:23.136362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.136877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.137311 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.138020 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.138473 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.138909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.274971 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:23.282773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62ab087a-061c-47a5-a584-1ba7900286ba tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.157738 Sep 13 13:08:23.283342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 232/468] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:23 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:23.348324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:23.348937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:23.356113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.356601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.357038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.357727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.358202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.358624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.425773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:23.425773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:23.431782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.432277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.432704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.433422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:23.433940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:23.434361 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:23.525965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:23.534767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:23.536205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:23.537371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36e79db3-0a3f-4f9d-ab48-9380c014b317 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.192897 Sep 13 13:08:23.537959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 237/469] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:23 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:23.581762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:23.589891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8e4665fd-6b92-41e7-b87f-8131ebf074d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.169337 Sep 13 13:08:23.590459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 233/470] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:23 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:24.305842 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:24.306418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:24.312486 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.312990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.313465 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.314188 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.314645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.315080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.443999 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:24.452206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1492b7eb-802d-4365-a8fc-feb2ba8176ce tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.150447 Sep 13 13:08:24.452761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 238/471] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:24 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:24.563739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:24.564344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:24.571171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.571651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.572170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.572860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.573313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.573764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.613405 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:24.614051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:24.620131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.620814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.621068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.628275 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:24.628275 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:24.628275 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:24.758530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:24.766928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:24.768348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:24.769494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6fc4b166-6c91-4795-ade1-f3a6f6154eed tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.209760 Sep 13 13:08:24.770111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 234/472] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:24 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:24.787903 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:24.796297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d30b241-63a4-4807-8ffd-4eb921104878 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.186667 Sep 13 13:08:24.796875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 239/473] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:24 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:25.475391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:25.475997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:25.482009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.482489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.482920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.483595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.484042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.484460 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.614737 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:25.623042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c702e6bf-3c48-4e24-b113-188934805432 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.151461 Sep 13 13:08:25.623598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 235/474] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:25 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:25.796761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:25.797366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:25.803789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.804267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.804700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.806055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.806506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.806929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.818461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:25.819015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:25.825716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.826245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.826689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.827558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:25.828041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:25.828466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:25.998121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:26.006818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:26.008337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:26.009509 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7601225c-7554-4fbc-afd4-17fc208ebd74 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.216618 Sep 13 13:08:26.010091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 240/475] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:25 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:26.012348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:26.019958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-031dcb11-11a3-409f-a9a5-b3c962872199 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.205322 Sep 13 13:08:26.020504 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 236/476] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:25 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:26.646163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:26.646776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:26.652701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:26.653190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:26.653628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:26.654349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:26.654804 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:26.655258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:26.786392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:26.794294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc27f9de-c287-4120-a6d1-da7e4fa77ad6 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.152039 Sep 13 13:08:26.794884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 241/477] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:26 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:27.034548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:27.035163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:27.042578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.043063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.043500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.044192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.044644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.044973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:27.045372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.045584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:27.052093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.052576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.053011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.053697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.054176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.054600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.238104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:27.241952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:27.248038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:27.249482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:27.250714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51c2345f-e783-41d6-9125-10c3344dcc36 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.220111 Sep 13 13:08:27.251278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 237/478] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:27 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:27.251802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-31a9a706-351b-42a4-b440-9b24e102d708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.210807 Sep 13 13:08:27.252363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 242/479] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:27 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:27.817579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:27.818238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:27.824937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.825423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.825904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.826597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:27.827054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:27.827485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:27.958359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:27.967262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a12970b-00c7-4b57-a700-fb2317116f61 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.153578 Sep 13 13:08:27.967815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 238/480] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:27 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:28.275514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:28.276054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:28.276409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:28.276505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:28.282634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.282787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.283113 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.283230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.283563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:28.283662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:28.284226 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.284339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.284672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.284778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.285120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:28.285231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:28.483115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:28.485530 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:28.491697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:28.493945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:28.494093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-444d362a-ccff-42e5-8820-c96637ad12ba tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.222693 Sep 13 13:08:28.494580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 243/481] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:28 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:28.495121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1ca6668-9c54-47d9-be46-1bc03359466a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.223515 Sep 13 13:08:28.495653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 239/482] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:28 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:28.990064 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:28.990704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:28.996826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.997306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.997759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:28.998471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:28.998919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:28.999341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:29.127520 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:29.135745 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ae31b240-d2f9-4b49-96f9-cbc588b58992 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.149524 Sep 13 13:08:29.136305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 244/483] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:28 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:29.517867 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:29.518475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:29.520217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:29.520834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:29.525539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:29.526039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:29.526467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:29.527149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:29.527595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:29.527828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:29.528009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:29.528318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:29.528760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:29.529455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:29.529949 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:29.530383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:29.720703 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:29.724933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:29.728747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-24bae637-7ab0-46e3-a42f-1a54207b6235 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.214717 Sep 13 13:08:29.729329 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 240/484] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:29 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:29.734017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:29.735466 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:29.736626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-080a2f94-6db0-4a76-a208-11db3f055bfa tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.220264 Sep 13 13:08:29.737180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 245/485] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:29 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:30.158883 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:30.159486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:30.166950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.167430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.167859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.168613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.168976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.169392 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.303263 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:30.311540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03bd9748-acac-4819-a5bc-2058339a1b15 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.156467 Sep 13 13:08:30.312101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 241/486] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:30 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:30.752409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:30.753018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:30.760420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.760955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.761393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.762110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.762560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.762980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.763358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:30.763959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:30.769727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.770233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.770666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.771339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:30.771787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:30.772203 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:30.775468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:30.960173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:30.963997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:30.968746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d0b3fe7b-b73d-4339-8008-3b072a037c5b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.220094 Sep 13 13:08:30.969315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 246/487] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:30 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:30.972686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:30.974187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:30.975331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-433a23b0-26ff-481f-ad77-31edf7872baf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.216228 Sep 13 13:08:30.975871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 242/488] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:30 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:31.334096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:31.334704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:31.340582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:31.341063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:31.341495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:31.342212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:31.342664 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:31.343086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:31.507855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:31.507855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-55f01ad5-2af2-4f5e-8482-ec6cc4e0a5ea tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.152928 Sep 13 13:08:31.507855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 247/489] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:31 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:31.993933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:31.993933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:32.000079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:32.016040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.016210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:32.016305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.016305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.016305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.016305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.016637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.016718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.016718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.016718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.016718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.017009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.017009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.189397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:32.198332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f0fb500-fcbc-4fb0-b3f0-9e3e61e5d892 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.209749 Sep 13 13:08:32.198991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 243/490] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:31 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:32.215505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:32.224287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:32.225747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:32.227435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fa892ac7-6f76-4a21-9c9a-6bc04d115f37 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.230659 Sep 13 13:08:32.228252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 248/491] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:31 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:32.506787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:32.507315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:32.513216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.513835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.514275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.514956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:32.515409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:32.515830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:32.647555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:32.656085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-35145b47-896b-46a6-80b0-a172cb10684d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.153304 Sep 13 13:08:32.656640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 244/492] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:32 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:33.222224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:33.222839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:33.229445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.229977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.230417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.231102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.231556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.231980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.254953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:33.255625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:33.265565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.266022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.266458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.267180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.267632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.268058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.436798 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:33.440509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:33.444606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c2a41341-1f11-4e43-bbe7-38c36f24190f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.226190 Sep 13 13:08:33.445178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 249/493] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:33 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:33.449990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:33.451440 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:33.452585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-90488d86-be9a-4b70-8767-13f492d3c395 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.201556 Sep 13 13:08:33.453155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 245/494] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:33 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:33.679426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:33.680646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:33.686747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.687174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.687607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.688285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:33.688736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:33.689159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:33.818928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:33.826677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-77a7edf0-b793-4fbb-b349-5ce800750a71 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.151080 Sep 13 13:08:33.827235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 250/495] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:33 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:34.468534 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:34.469188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:34.475906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.476388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.476937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:34.477921 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:34.478347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.478560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:34.478668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.479084 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:34.485069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.485555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.486135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:34.486824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.487284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.487709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:34.668309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:34.672436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:34.676430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b0338cb2-69c8-409d-83b0-2d73f76c5c7a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.211713 Sep 13 13:08:34.677007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 246/496] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:34 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:34.681060 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:34.682775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:34.683935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4431a33-7e32-4aa2-a4c3-798a8dd51db6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.210650 Sep 13 13:08:34.684494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 251/497] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:34 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:34.848819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:34.849378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:34.855909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.856397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.856831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:34.857590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:34.858063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:34.858486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:35.024069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:35.031434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cf563021-870b-47ea-957b-19e465c4adde tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.186532 Sep 13 13:08:35.031990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 247/498] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:34 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:35.699000 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:35.699612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:35.706186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:35.706707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:35.707180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:35.707871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:35.708330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:35.708759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:35.709055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:35.709667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:35.716543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:35.717025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:35.717462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:35.718181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:35.718636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:35.719058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:35.927905 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:35.930129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:35.936250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bd077a41-d141-42f1-859f-5487c253fada tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1681 microversion: 2.1 time: 0.241058 Sep 13 13:08:35.936824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 252/499] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:35 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:35.947167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:35.957024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:35.958609 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:35.959884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93a093f1-e43d-4878-bcd7-ee4b9548c63b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.254669 Sep 13 13:08:35.960517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 248/500] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:35 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:36.054337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:36.055017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:36.061305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:36.061815 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:36.062251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:36.062944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:36.063411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:36.063823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:36.352658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:36.360337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7b49e966-42fc-47ca-8b62-44bac92d9f50 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1259 microversion: 2.1 time: 0.310183 Sep 13 13:08:36.361610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 253/501] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:36 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:36.960435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:36.962335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:36.968484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:36.969043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:36.969546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:36.970344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:36.970869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:36.971363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:36.987532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:36.990150 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:36.997544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:36.997722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:36.998236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.000214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.000214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.000214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.074433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.082417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-799b4979-267e-427a-bbda-78a353949d53 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1614 microversion: 2.1 time: 0.125953 Sep 13 13:08:37.082988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 249/502] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:36 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:37.200168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc", "name": "network-vif-deleted", "tag": "e42f6f1f-ed4b-41d3-a2b4-ba1b11365103"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:37.213133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.221145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.222915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.222915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.223102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.224051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.225216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-794f678f-97b5-4258-b6bd-5dca569d6d65 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.242187 Sep 13 13:08:37.226363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 254/503] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:36 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:08:37.240718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] Creating event network-vif-deleted:e42f6f1f-ed4b-41d3-a2b4-ba1b11365103 for instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc on hv-cinder-80135 Sep 13 13:08:37.248171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-768ed00e-9be0-467d-a49b-c080d5c8ece3 req-63401e8c-1fe4-4a42-822e-1d457dee414b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052481 Sep 13 13:08:37.248995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 250/504] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:37.385557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:37.386376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:37.394460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.395588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.396233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.397928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.399642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.406380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.493760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4810de91-96cb-4df7-873e-95cccb8e013b"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:37.496319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:37.504490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.505475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.506172 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.507117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.507658 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.508764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.579035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.587603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fdd2d924-284c-4a4b-96b5-1c49ef46e8da tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1443 microversion: 2.1 time: 0.206039 Sep 13 13:08:37.588171 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 255/505] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:37 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1443 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:37.612776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:37.613398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:37.622669 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.623932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.624542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.625399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.626050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:37.626687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:37.799050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:37.812421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8dc0f7b7-a216-4197-9564-834924592a43 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1443 microversion: 2.1 time: 0.203496 Sep 13 13:08:37.822014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 256/506] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:37 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1443 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:37.983643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:37.984157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:37.992739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:37.998556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.000744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.006425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.007157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.007989 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.343729 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lazy-loading 'services' on Instance uuid 9571f561-e164-4b23-8ffe-8fc0cfcb7321 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:08:38.395031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-989aebbe-1039-4d48-baca-968b65f454ca tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905941 Sep 13 13:08:38.396216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 251/507] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:08:37 2022] POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:08:38.420641 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:38.424127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:38.439765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.441294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.444615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.446114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.449017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.449456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.539548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.540977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.541426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.546522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'fault' on Instance uuid a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:08:38.647878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:38.660136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c8d36703-f051-400f-977c-80a8ae6eaef5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 200 len: 1331 microversion: 2.1 time: 0.262455 Sep 13 13:08:38.678709 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 252/508] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:38 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 1331 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:38.690884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:38.691989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:38.719973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.725322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.725322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.725322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:38.725322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:38.725941 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:38.761180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-748f6d94-cae2-44ba-ada5-c4fc9b92f72b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments/b866cd90-d914-4d85-9540-c2bc6fc1e940" status: 202 len: 0 microversion: 2.1 time: 0.779556 Sep 13 13:08:38.763280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 257/509] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:08:37 2022] DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments/b866cd90-d914-4d85-9540-c2bc6fc1e940 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:08:38.983049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:38.995543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:39.001659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:39.003542 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-39b9873e-1f9f-4690-9403-071133931556 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.323923 Sep 13 13:08:39.005257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 253/510] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:38 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:39.692070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:39.693024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:39.701148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:39.701931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:39.702373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:39.703500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:39.704116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:39.704712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:39.718973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc HTTP/1.1 Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:08:39.720659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:08:39.722332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc'} Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:08:39.723234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:08:39.724792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:08:39.726208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:08:39.726208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af43f3d0-7a9e-4767-87d0-d747ab471b97 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 404 len: 111 microversion: 2.1 time: 0.034402 Sep 13 13:08:39.726208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 258/511] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:39 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:08:39.733054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1fc32a4b-02d6-456b-adb3-2f8141716ce3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '.version_select at 0x7f15650e73a0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:39.821157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1fc32a4b-02d6-456b-adb3-2f8141716ce3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348147034" status: 202 len: 0 microversion: 2.1 time: 0.092494 Sep 13 13:08:39.822136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 254/512] 10.222.0.72 () {58 vars in 1221 bytes} [Tue Sep 13 13:08:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348147034 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:08:40.040977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:40.040977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:40.040977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.041294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.041960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.042810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.043430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.044084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.307370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:40.317158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:40.318863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:40.320207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2c7792a-78a3-4fc8-a168-de00030b5641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.291515 Sep 13 13:08:40.321259 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 259/513] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:40 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:40.512230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "name": "network-vif-plugged", "status": "completed", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:40.525479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.526002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.526403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.536912 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] Creating event network-vif-plugged:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:08:40.542530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-02ff58a3-072c-428e-a7a0-24bca6ce344b req-6f196741-6b06-486d-84d4-79cf6db019b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Sep 13 13:08:40.543160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 255/514] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:40.682263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:40.682996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:40.689156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.689646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.690197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.691108 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.691578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.692178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.791608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'services' on Instance uuid 42476fd8-5bc5-47f9-8aa9-da3e3012656b {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:08:40.828618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:40.847152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:40.847637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:40.848070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:40.873289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] Creating event network-changed:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:08:40.880821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ca3c907c-2c80-4d35-967c-12d5eaf553c1 req-537dc4a6-f2a2-4c81-b43a-fa0a38545d21 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058691 Sep 13 13:08:40.880821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 256/515] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:08:41.088296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1192dbed-7fd0-4ad1-b64f-2f6648c04e41 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments/72ceebaf-1fdc-4442-a872-38aa50736b27" status: 202 len: 0 microversion: 2.1 time: 0.409946 Sep 13 13:08:41.088893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 260/516] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:08:40 2022] DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments/72ceebaf-1fdc-4442-a872-38aa50736b27 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:08:41.098165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:41.101054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:41.115533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:41.116238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:41.116834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:41.118409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:41.119720 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:41.120314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:41.158029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7ef589f0-82d5-4cbe-9bbc-2d73fea1de1b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063806 Sep 13 13:08:41.158813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 257/517] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:41 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:41.347947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:41.348650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:41.355600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:41.356095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:41.356725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:41.357586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:41.358086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:41.358684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:41.567045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:41.576779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:41.578283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:41.579632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-29114bd5-1f72-43c0-b368-7deb9b8b56f4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.236165 Sep 13 13:08:41.581786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 261/518] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:41 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:42.171934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:42.174503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:42.181453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:42.181974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:42.182408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:42.183096 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:42.183547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:42.183966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:42.213480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-409e88c1-b60c-4dc4-99ae-dda7f33065d7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Sep 13 13:08:42.214070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 258/519] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:42 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:42.605952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:42.606738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:42.613134 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:42.613608 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:42.614073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:42.614794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:42.615245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:42.615665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:42.748983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:42.760460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:42.762291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:42.763561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4931a724-ae11-4db8-a619-cb1f8e00e195 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.162426 Sep 13 13:08:42.764254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 262/520] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:42 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:43.225788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:43.228245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:43.236295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:43.236988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:43.237431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:43.238150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:43.238763 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:43.239362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:43.271058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a4c67de0-44d8-43c6-bdb1-1cc08dfa38a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049101 Sep 13 13:08:43.271622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 259/521] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:43 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:43.791794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:43.792442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:43.801105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:43.801601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:43.802069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:43.802773 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:43.803232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:43.803661 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:43.941585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:43.952991 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:43.954554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:43.955781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-99eea764-954e-4640-a6c0-6a83084b00e1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1810 microversion: 2.20 time: 0.169354 Sep 13 13:08:43.956411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 263/522] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:43 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:44.283548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:44.285724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:44.292408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:44.292888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:44.293321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:44.294046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:44.294500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:44.294922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:44.297453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:44.326791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b011af75-aace-431b-804c-c16857f0e64b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047108 Sep 13 13:08:44.327562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 260/523] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:44 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:44.983599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:44.984214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:44.990589 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:44.991076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:44.991516 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:44.992258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:44.992734 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:44.993135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:45.124270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:45.133460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:45.134926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:45.136068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cd6c20af-e9a3-41f1-9381-ba12c677be73 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1797 microversion: 2.20 time: 0.156352 Sep 13 13:08:45.136620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 264/524] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:08:44 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:08:45.343010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:45.345151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:45.351922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:45.353950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:45.353950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:45.353950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:45.354236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:45.354499 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:45.384887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d7c7e32f-4767-489f-a16b-028c58baae21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Sep 13 13:08:45.385368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 261/525] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:45 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:46.397644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:46.401208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:46.408545 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:46.409028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:46.409804 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:46.410674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:46.411129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:46.411551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:46.444488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f67770c0-7990-4e94-ab95-50a6ec31706b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051884 Sep 13 13:08:46.445088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 265/526] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:46 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:47.457171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:47.459340 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:47.462403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:47.467369 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:47.467852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:47.468286 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:47.468963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:47.469411 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:47.469857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:47.498363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2b46500-f89a-4e01-b114-59cea8a74654 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Sep 13 13:08:47.498910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 262/527] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:47 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:48.512165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:48.514485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:48.520985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:48.521468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:48.521935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:48.522638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:48.523766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:48.524353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:48.556939 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8789d44-e18e-49da-99b2-7f265f47a499 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048609 Sep 13 13:08:48.557651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 266/528] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:48 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:49.571000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:49.573170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:49.580291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:49.588669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:49.588669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:49.588669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:49.588669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:49.589031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:49.614098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bfdb15ad-05cf-4cfe-a2b2-ab2a2a58601b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048341 Sep 13 13:08:49.614665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 263/529] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:49 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:50.627541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:50.629624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:50.637067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:50.638004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:50.638004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:50.638686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:50.639133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:50.639554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:50.669263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9724d087-bbfa-41f8-9547-37dfea1d20a3 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Sep 13 13:08:50.669840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 267/530] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:50 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:51.686637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:51.688776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:51.695350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:51.695924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:51.696399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:51.697139 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:51.697595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:51.698046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:51.727714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d1b4edf0-55e2-4246-a399-e32ea8429144 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Sep 13 13:08:51.728262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 264/531] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:51 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:52.739970 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:52.742381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:52.745043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=68 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:52.749623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:52.750139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:52.750573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:52.751254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:52.751751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:52.754998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:52.778525 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:08:52.783124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-257eface-1648-4889-8ba4-88971646c515 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047136 Sep 13 13:08:52.783670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 268/532] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:52 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:53.796391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:53.799048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:53.805821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:53.806309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:53.806748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:53.807510 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:53.807963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:53.808388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:53.839162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0669401f-abf1-4e5a-972c-57b6b1f775e7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Sep 13 13:08:53.839790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 265/533] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:53 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:54.853910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:54.856502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:54.863887 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:54.865160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:54.865611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:54.866475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:54.867448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:54.867880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:54.899247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4c81b572-8817-45ab-b92a-df2baf7eb6ce tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051930 Sep 13 13:08:54.899800 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 269/534] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:54 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:55.911942 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:55.915849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:55.922273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:55.922763 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:55.923206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:55.923902 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:55.924358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:55.924790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:55.955931 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e20d71b4-7e92-42f3-88e4-5900be5e1268 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Sep 13 13:08:55.956489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 266/535] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:55 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:08:56.625104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:56.627415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:56.635295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:56.635787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:56.636228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:56.636929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:56.637540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:56.637828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:56.660749 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'flavor' on Instance uuid e055f96e-b9e5-4957-a7cb-b962a0868dbd {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:08:56.968665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:56.970857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:56.977724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:56.978236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:56.978759 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:56.979451 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:56.979906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:56.980331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.010204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6cd19790-083f-472b-8932-55a519b2b61d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Sep 13 13:08:57.010746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 267/536] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:56 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:08:57.015293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:08:57.020673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:57.021152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:57.021588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.044235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Going to try to stop instance {{(pid=121102) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 13:08:57.103458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-778e50be-4c65-4e11-9714-071865ac7bfe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/action" status: 200 len: 32 microversion: 2.1 time: 0.482277 Sep 13 13:08:57.104058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 270/537] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:08:56 2022] POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/action => generated 32 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:08:57.113604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:57.114342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:57.126929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:57.127509 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:57.127946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.128651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:57.129100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:57.129521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.261802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:57.270135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a96011b-9e4d-482f-8805-ebfba78e2514 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.160419 Sep 13 13:08:57.270643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 271/538] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:57 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:57.302619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-598b23a9-7f2b-43c4-8ac3-86f967dc6e90 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action" status: 202 len: 0 microversion: 2.1 time: 0.290653 Sep 13 13:08:57.304784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 268/539] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:08:57 2022] POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:08:57.326420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:57.327023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:57.333096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:57.333622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:57.334749 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.335447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:57.335938 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:57.337393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:57.536223 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:57.544717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c98111e5-8be6-4e8d-956a-d31262aca98a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.222228 Sep 13 13:08:57.545287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 272/540] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:57 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:58.023262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:58.027395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:58.033091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.033579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.034090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.034776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.035225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.035642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.065399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1a4f52ef-8998-4cf8-b2b9-e61bb177740c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046484 Sep 13 13:08:58.066049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 269/541] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:08:58 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:08:58.132557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:58.133064 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:58.140387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.140875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.141309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.142051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.142493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.142918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.169050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:08:58.293628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:58.294259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:58.300070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.300547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.300980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.301654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.302136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.302556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.400952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1ca27a9f-8639-436d-9a60-16afb3dc5bcd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 204 len: 0 microversion: 2.1 time: 0.271957 Sep 13 13:08:58.401563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 273/542] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:08:58 2022] DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:08:58.409902 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:58.410653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:58.416902 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.417387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.417934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.418633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.419095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.419519 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.437711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:58.446619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-912e69a5-96ac-4063-a767-87fb6fd4f5a5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.156368 Sep 13 13:08:58.447343 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 270/543] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:58 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:58.559075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:58.567027 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa8fec22-6c11-40c3-a87d-8f5e0cd00c67 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1682 microversion: 2.1 time: 0.161087 Sep 13 13:08:58.568950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:58.569595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:58.576102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.576616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.577114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.577732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:58.578207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:58.578629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:58.582012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 274/544] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:58 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:58.708845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:58.716733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-04d21b80-06a7-4228-ad65-423d79e99d5f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.152818 Sep 13 13:08:58.717291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 271/545] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:58 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:08:59.470063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:59.470677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:59.477055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.477596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.478067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.478760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.479219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.479647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.591453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:59.591989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:59.598413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.599078 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.599725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.600211 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.600668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.601092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.610407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:59.618565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cfea4588-55a5-4bc7-84a9-374e87ea165c tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.152379 Sep 13 13:08:59.619128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 275/546] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:59 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:59.729338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:59.736956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f76aef0-7d9f-4db3-959e-02d834f887e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1682 microversion: 2.1 time: 0.149543 Sep 13 13:08:59.737514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 272/547] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:59 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:08:59.741790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:08:59.742897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:08:59.748942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.749436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.749915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.750613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:08:59.751070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:08:59.751500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:08:59.882613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:08:59.891826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-aa4bd06f-2470-4cd9-b3ec-ad959105e327 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.153803 Sep 13 13:08:59.892397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 276/548] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:08:59 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:00.641615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:00.642304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:00.648418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.649450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.649918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:00.650617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.651071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.651493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:00.766301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:00.767083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:00.773567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.774737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.775183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:00.775884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.776339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.776762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:00.879892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:00.888758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-40f3b7b4-d291-4703-8ff7-5e0dfd34d0eb tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.250874 Sep 13 13:09:00.889262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 273/549] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:00 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:00.915125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:00.915730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:00.921789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.922278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.922711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:00.923398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:00.923853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:00.924271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:01.011178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:01.019031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-229abdc6-cb7c-4ce6-bab7-6a69c924fc61 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1682 microversion: 2.1 time: 0.256556 Sep 13 13:09:01.019607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 277/550] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:00 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:01.110709 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:01.119524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d49b6338-c3e0-47cb-bbab-c1b90b7bfee8 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.208550 Sep 13 13:09:01.120165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 274/551] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:00 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:01.361838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42476fd8-5bc5-47f9-8aa9-da3e3012656b", "name": "network-vif-deleted", "tag": "c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:01.371787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:01.372273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:01.372716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:01.384176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] Creating event network-vif-deleted:c1bb16ae-8c0f-4622-bcf4-fc93bfe65e0c for instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b on hv-cinder-80135 Sep 13 13:09:01.389264 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-1c0fb990-b45e-4860-bbb3-79e8b9100301 req-2de16b26-b220-49ee-9830-fb26765ec481 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031064 Sep 13 13:09:01.390199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 278/552] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:01.913148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:01.913895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:01.921621 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:01.922219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:01.922728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:01.923667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:01.924197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:01.924823 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.046092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:02.046806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:02.053262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:02.053778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:02.054225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.055030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:02.055487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:02.056090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.088726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:02.090125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:02.090624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:02.091066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.091254 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:02.091526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'fault' on Instance uuid 42476fd8-5bc5-47f9-8aa9-da3e3012656b {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:09:02.098278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7a8a6ce-4bf2-42a0-8486-aa151709fd5e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.189504 Sep 13 13:09:02.106204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 275/553] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:01 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:02.146593 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:02.148276 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:02.149940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:02.155346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f760a69e-11d8-4e11-9601-cc9183985e4c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 200 len: 1331 microversion: 2.1 time: 0.113900 Sep 13 13:09:02.156552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 279/554] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:02 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:02.163924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:02.165126 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:02.165571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.166304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:02.166758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:02.167179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:02.328238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:02.337373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a48e4cd0-03b6-4ae2-9482-06d0a604803d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.196061 Sep 13 13:09:02.338433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 276/555] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:02 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:03.128347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:03.129004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:03.136125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.136607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.137040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.137723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.138197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.138617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.181387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:03.182020 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:03.188357 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.188847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.189276 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.189996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.190450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.190871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.205295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b HTTP/1.1 Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:09:03.207013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:09:03.208425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '42476fd8-5bc5-47f9-8aa9-da3e3012656b'} Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:09:03.209442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:09:03.218921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:03.221425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:09:03.221425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b48eb3d-2d1f-4e1e-9c05-7849542274a8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 404 len: 111 microversion: 2.1 time: 0.030844 Sep 13 13:09:03.221425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 277/556] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:03 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:09:03.225137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f48c005-7d3b-43ee-98b8-4d4306d33cc2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '.version_select at 0x7f1565351f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:03.270110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:03.278847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-272e0f8c-e460-4ca6-9be7-f46b36ddca63 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.154309 Sep 13 13:09:03.279401 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 280/557] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:03 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:03.357161 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f48c005-7d3b-43ee-98b8-4d4306d33cc2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782145439" status: 202 len: 0 microversion: 2.1 time: 0.135829 Sep 13 13:09:03.357848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 278/558] 10.222.0.72 () {58 vars in 1218 bytes} [Tue Sep 13 13:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782145439 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:09:03.363777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:03.364389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:03.370449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.370935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.371372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.372107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:03.372559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:03.372985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:03.549615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:03.557446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b43f441-a275-4b6d-bf82-44d6b7d59933 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.197668 Sep 13 13:09:03.558034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 281/559] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:03 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:04.171863 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8041feb-f668-4674-a248-648ed0853f5e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: .version_select at 0x7f1565092b80>, body: {"keypair": {"name": "tempest-keypair-1653457710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJ9cpewvS0QvfMbSO79Qtdut0edwDKAgS/mjC8U8gBD5y/tXiQcvJQPNPIA10JgH8LAqwNPpexjll2fXfJv6uubE9pGOgNAUZhuxOe36WgsrNP3x9NPXIm4OybLL/KF+g=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:04.189705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-b8041feb-f668-4674-a248-648ed0853f5e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:09:04.194779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-b8041feb-f668-4674-a248-648ed0853f5e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:09:04.271368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8041feb-f668-4674-a248-648ed0853f5e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103355 Sep 13 13:09:04.272047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 279/560] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:09:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:04.303263 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:04.303879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:04.311115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:04.311609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:04.312049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:04.312767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:04.313246 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:04.313673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:04.316445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:04.452269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:04.460573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-411af9fd-ac90-4ae5-98da-2f594ab488e8 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.161275 Sep 13 13:09:04.461310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 282/561] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:04 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:04.581580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:04.582746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:04.588898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:04.589381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:04.590036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:04.590723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:04.591173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:04.591591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:04.729219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:04.736954 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7598f196-5333-4249-a52f-04a284208843 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.160366 Sep 13 13:09:04.737637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 280/562] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:04 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:05.484859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:05.485477 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:05.492068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:05.493344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:05.493344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:05.494085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:05.494546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:05.494978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:05.715642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:05.723737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5cec2010-4c6b-4110-a730-0208a1cfae98 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.243140 Sep 13 13:09:05.724298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 283/563] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:05 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:05.761565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:05.765688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:05.768315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:05.768802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:05.769241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:05.769995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:05.770453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:05.770878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:05.949017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:05.956907 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7b429eca-c183-4a32-9960-c61ebe77bc9e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.199778 Sep 13 13:09:05.957508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 281/564] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:05 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:06.747831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:06.748547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:06.754933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:06.755489 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:06.755994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:06.756695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:06.757148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:06.757571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:06.766456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1492720709", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f0b8231-ada5-4945-87a4-d1b052328819"}], "security_groups": [{"name": "tempest-securitygroup--463423305"}], "key_name": "tempest-keypair-1653457710", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:06.901595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] validate_networks() for [('1f0b8231-ada5-4945-87a4-d1b052328819', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:09:06.968576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:06.976955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b229b7fe-4e7f-4c7a-b33e-2f7ac327e05f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.232958 Sep 13 13:09:06.977524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 284/565] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:06 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:06.982841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:06.983455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:06.989172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:06.989665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:06.990165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:06.990865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:06.991322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:06.991763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:07.399642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:07.407321 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e3bdb9dd-e2ef-4597-b25e-80f3a6bf514b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1678 microversion: 2.1 time: 0.428808 Sep 13 13:09:07.407894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 285/566] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:06 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1678 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:07.566930 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:09:07.567355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:09:07.567824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:09:07.568229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:09:07.568635 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:09:07.577521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:07.578039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:07.578475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:07.579199 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:07.579651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:07.580070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:07.596890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:09:07.601114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:09:07.613070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:09:07.615374 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:09:07.723665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e96aba1-c8ef-442e-841a-90c8a8351f71 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.961549 Sep 13 13:09:07.724828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 282/567] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:09:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:09:07.736814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98ca697a-35b6-4738-9da6-a1d48f90023b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:07.737423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98ca697a-35b6-4738-9da6-a1d48f90023b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:07.799205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-98ca697a-35b6-4738-9da6-a1d48f90023b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:07.807283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98ca697a-35b6-4738-9da6-a1d48f90023b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1242 microversion: 2.1 time: 0.074354 Sep 13 13:09:07.807901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 286/568] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:07 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:08.000569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:08.001546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:08.008441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.008943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.009372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.010193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.010647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.011072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.155671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:08.159561 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c7cc9a5e-66e6-431a-b37c-2e37928b0c67 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.162875 Sep 13 13:09:08.160123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 283/569] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:07 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:08.430519 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:08.431198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:08.437165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.437678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.438151 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.438836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.439288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.439710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.572493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:08.580382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-74d5d1bb-736b-4b1b-9c11-da98972c867d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1655 microversion: 2.1 time: 0.154024 Sep 13 13:09:08.580945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 287/570] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:08 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:08.603005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:08.609201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.609685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.610173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.634661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Going to try to start instance {{(pid=121102) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 13:09:08.830239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:08.830855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:08.837620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.838137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.838579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.839265 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.839716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.840140 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.873714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9daf5e24-7648-4277-9705-41f487fe437f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action" status: 202 len: 0 microversion: 2.1 time: 0.274871 Sep 13 13:09:08.874370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 284/571] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:09:08 2022] POST /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:09:08.883914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:08.884964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:08.891821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.892299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.892731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.893418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:08.893906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:08.894309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:08.906504 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:08.914945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4d67024e-f35f-4ab8-93f7-b09d10255fbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1246 microversion: 2.1 time: 0.088233 Sep 13 13:09:08.915467 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 288/572] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:08 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:09.021002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:09.028521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9f7805e6-0ae9-448d-90ba-3837de213340 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1664 microversion: 2.1 time: 0.149783 Sep 13 13:09:09.029069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 285/573] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:08 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:09.183838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:09.184366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:09.190279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:09.190767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:09.191207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:09.191897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:09.192355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:09.192780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:09.332653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:09.341617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00882fe4-a7bd-44cd-852d-9995b1ff46a7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.162293 Sep 13 13:09:09.342224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 289/574] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:09 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:09.938517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:09.939131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:09.946049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:09.946585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:09.947097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:09.952223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:09.952223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:09.952223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:10.013921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:10.021673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-00b93303-a998-40bc-b661-f3e8aba1c01b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1238 microversion: 2.1 time: 0.087188 Sep 13 13:09:10.022280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 286/575] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:09 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:10.052260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:10.052870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:10.059828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:10.060311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:10.060746 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:10.061430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:10.061914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:10.062338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:10.192336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:10.200586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8786ab83-375c-4ee5-8092-3aa32ff20d3a tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1664 microversion: 2.1 time: 0.152180 Sep 13 13:09:10.201150 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 290/576] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:10 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:10.364968 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:10.365586 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:10.372291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:10.372777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:10.373210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:10.373932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:10.374381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:10.374800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:10.656497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:10.665412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4a9dcfdf-9357-4658-b3bc-dfd047446d58 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1736 microversion: 2.1 time: 0.304448 Sep 13 13:09:10.666041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 287/577] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:10 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:11.046190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:11.046924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:11.052819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.053399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.053732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.054539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.055008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.055506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.120540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:11.128187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cf4513e9-7b53-44c7-91d0-6d5ecdbd2240 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1294 microversion: 2.1 time: 0.085841 Sep 13 13:09:11.128754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 291/578] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:11 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:11.224004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:11.224614 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:11.231197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.231687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.232165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.232854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.233310 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.233753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.458925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:11.467436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6ce54aee-db76-4394-84ef-81aa99ba8e8b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1664 microversion: 2.1 time: 0.247391 Sep 13 13:09:11.468012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 288/579] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:11 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1664 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:11.689724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:11.690357 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:11.696890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.697376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.697840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.698549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:11.699017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:11.699448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:11.961922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:11.970969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-050b6764-09ce-443f-a071-1d645e918255 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1716 microversion: 2.1 time: 0.285129 Sep 13 13:09:11.986056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 292/580] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:11 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:12.087246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:12.089998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:12.093814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.094302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.094740 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.095457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.095914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.096336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.154515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:12.155124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:12.161398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.161922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.162361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.163053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.163504 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.164708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.227352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] HTTP exception thrown: Cannot 'detach_volume' instance e055f96e-b9e5-4957-a7cb-b962a0868dbd while it is in vm_state rescued Sep 13 13:09:12.228005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Request method failure captured: Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments/4810de91-96cb-4df7-873e-95cccb8e013b HTTP/1.1 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIASKZPtsIVlBDGq0ZWz3eFJS9tbLg_35fH1gurhTIAWQfK20jXGlxDguI8j7D_XlJMoUcCS1Swki_Kfq8g52gAEshJFAnSI91fMfuA2Qkpq4ha-xsqjszQs2XPOaRI0mePWSIU7GA1aBGb9s283gH_H8JCgOnAxtZkAfEGK8RXJIXw Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:09:12.228974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c15624f4312f49bb85a7a086c291d157", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 8c688fff323943b3bbcbb0569d974d0a Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:09:12.230347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Cannot 'detach_volume' instance e055f96e-b9e5-4957-a7cb-b962a0868dbd while it is in vm_state rescued Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'server_id': 'e055f96e-b9e5-4957-a7cb-b962a0868dbd', 'id': '4810de91-96cb-4df7-873e-95cccb8e013b'} Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:09:12.231002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e055f96e-b9e5-4957-a7cb-b962a0868dbd while it is in vm_state rescued Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e055f96e-b9e5-4957-a7cb-b962a0868dbd while it is in vm_state rescued Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:12.232157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Returning 409 to user: Cannot 'detach_volume' instance e055f96e-b9e5-4957-a7cb-b962a0868dbd while it is in vm_state rescued {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:09:12.233105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-433446ce-8756-4a32-9d2c-93f805000740 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments/4810de91-96cb-4df7-873e-95cccb8e013b" status: 409 len: 152 microversion: 2.1 time: 0.147656 Sep 13 13:09:12.233105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 289/581] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:09:12 2022] DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments/4810de91-96cb-4df7-873e-95cccb8e013b => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 13:09:12.236012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-604e2da3-4c4d-4faf-a24c-3fd3b22ba340 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1312 microversion: 2.1 time: 0.085324 Sep 13 13:09:12.236564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 293/582] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:12 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1312 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:12.238844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:12.239365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:12.249435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.250045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.250474 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.251152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.251599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.252012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.438532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-55524d6d-e26b-45f7-891f-83d3ce116f4e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.203004 Sep 13 13:09:12.439556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 290/583] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:09:12 2022] POST /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:09:12.447397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:12.448010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:12.454214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.454701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.455169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.456808 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.457268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.457694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.495677 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:12.496290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:12.503119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.503613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.504053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.504758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:12.505215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:12.505644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:12.663016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:12.672943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6d69d947-b2a7-4ee6-9d94-1fea94e45918 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1724 microversion: 2.1 time: 0.229263 Sep 13 13:09:12.673520 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 294/584] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:12 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:12.712618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:12.720410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-75a0b307-3293-4bc8-8445-2671e0258967 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1664 microversion: 2.1 time: 0.229795 Sep 13 13:09:12.721420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 291/585] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:12 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:13.260517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:13.261056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:13.268526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.269034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.269625 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:13.270550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.271054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.271448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:13.366045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:13.374784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e74fc0fb-74e2-4d75-8e37-eda7d1cff70e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1300 microversion: 2.1 time: 0.119072 Sep 13 13:09:13.376521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 295/586] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:13 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:13.696074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:13.696711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:13.703109 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.703584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.704015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:13.704692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.705137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.705578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:13.745003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:13.745604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:13.751793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.752281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.752762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:13.753455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:13.753932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:13.754358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:14.352927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:14.360939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8bd93cc6-f039-40a1-ae4a-b38bd7de9344 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1724 microversion: 2.1 time: 0.668890 Sep 13 13:09:14.361724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 292/587] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:13 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1724 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:14.381570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:14.390141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-635ac68c-f22c-4716-9719-2ed9bb745e07 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1668 microversion: 2.1 time: 0.649623 Sep 13 13:09:14.390710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 296/588] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:13 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1668 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:09:14.407108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:14.407662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:14.414526 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:14.415022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:14.415458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:14.416150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:14.416597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:14.417013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:14.743313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:14.746447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:14.752692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-86b61209-48f4-4d98-879a-a6cf35eec4ef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.349433 Sep 13 13:09:14.753230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 293/589] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:14 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:15.331775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89044a6-3b0a-4879-9409-b492f10c1f3f", "tag": "386ff3b9-fa41-4263-8bac-4134f8136d8e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:15.342720 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:15.343730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:15.343730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:15.356649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] Creating event network-changed:386ff3b9-fa41-4263-8bac-4134f8136d8e for instance e89044a6-3b0a-4879-9409-b492f10c1f3f on hv-cinder-80135 Sep 13 13:09:15.361817 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d81b7553-1115-4efe-875d-13ed2525ec70 req-d6a7788c-838c-45cf-b6e0-490c45d04107 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 Sep 13 13:09:15.362409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 297/590] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:09:15.385297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:15.385932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:15.392190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:15.392670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:15.393102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:15.393804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:15.394258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:15.394676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:15.526909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:15.535289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a95b624d-3272-46fe-8f5e-d4b2e06dfddc tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1724 microversion: 2.1 time: 0.154828 Sep 13 13:09:15.537162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 294/591] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:15 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:15.777317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:15.777981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:15.784276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:15.784760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:15.785201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:15.785933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:15.786392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:15.786819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:15.922270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:15.930601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a6782a4c-b1da-4494-b36b-ac40e84c458a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.158334 Sep 13 13:09:15.931157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 298/592] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:15 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:16.560336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:16.562761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:16.568017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:16.568514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:16.570399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:16.570399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:16.571168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:16.571275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:16.704545 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:16.713392 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ffdeaa9b-4403-4781-afef-38dd4717fce2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1724 microversion: 2.1 time: 0.157166 Sep 13 13:09:16.713958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 295/593] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:16 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:16.952462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:16.953077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:16.959698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:16.960184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:16.960683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:16.961448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:16.961937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:16.962368 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:17.089903 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:17.097540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-76dbc30d-4482-4536-aa9e-6f03ffd0fcc4 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.148938 Sep 13 13:09:17.098136 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 299/594] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:16 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:17.737350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:17.738016 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:17.740293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:17.740939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:17.745863 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:17.746340 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:17.746768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:17.747445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:17.747890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:17.748305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:17.927701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:17.936681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4bd57dd6-f5e5-4709-9537-f3200eedf617 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1730 microversion: 2.1 time: 0.203112 Sep 13 13:09:17.937235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 296/595] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:17 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:17.960023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:17.960714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:17.962601 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:17.967777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:17.968261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:17.968700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:17.969390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:17.969868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:17.978322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:17.983563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:18.047305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b54f41a9-79d8-4bb0-8dce-23a2617e07f1 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091114 Sep 13 13:09:18.047913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 300/596] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:09:17 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:18.120869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:18.122908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:18.128036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:18.128655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:18.129266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:18.130139 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:18.130696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:18.131355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:18.363239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:18.372083 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fe611056-e14c-4b52-8ec1-de97ed123aab tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.255425 Sep 13 13:09:18.372580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 297/597] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:18 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:19.035495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:19.047092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:19.047688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:19.048199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:19.062316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] Creating event network-changed:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:09:19.066169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-a671eaea-abb9-4bd7-8be6-c92b538d71d5 req-bf96911b-42bc-4b9e-88e4-936029820ebf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Sep 13 13:09:19.066942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 301/598] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:19.395277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:19.395998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:19.399200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:19.405280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:19.405817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:19.406263 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:19.410662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:19.410662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:19.410662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:19.864165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:19.873017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f993bef2-dfb9-4d58-bdd0-b3537003939f tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.481283 Sep 13 13:09:19.873822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 298/599] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:19 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:20.901641 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:20.902374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:20.908356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:20.912035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:20.912035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:20.912035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:20.912035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:20.912388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:21.045217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:21.053182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2763a1ba-d531-4516-9a52-36851c82ac33 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.156868 Sep 13 13:09:21.053760 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 302/600] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:20 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:21.080856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:21.091143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:21.091617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:21.092074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:21.103361 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] Creating event network-changed:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:09:21.108613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-4334cca6-2c47-43c5-a3b9-cacd69d3f3b1 req-8a94f7c6-3ada-4315-b81b-b19612b82412 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031358 Sep 13 13:09:21.109198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 299/601] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:22.075899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:22.076523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:22.083103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:22.083596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:22.084036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:22.084733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:22.085213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:22.085823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:22.212741 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:22.220304 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bf460c91-47aa-4104-95be-7848679747c8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.148178 Sep 13 13:09:22.220899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 303/602] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:22 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:22.866803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89044a6-3b0a-4879-9409-b492f10c1f3f", "name": "network-vif-plugged", "status": "completed", "tag": "386ff3b9-fa41-4263-8bac-4134f8136d8e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:22.876697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:22.877177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:22.877606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:22.888898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] Creating event network-vif-plugged:386ff3b9-fa41-4263-8bac-4134f8136d8e for instance e89044a6-3b0a-4879-9409-b492f10c1f3f on hv-cinder-80135 Sep 13 13:09:22.893825 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-8ef1b1cc-a2fb-4d7d-8a44-ceca1202a6d2 req-a7feaa48-2dbc-468e-b859-5d88aad4706f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031683 Sep 13 13:09:22.894349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 300/603] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:09:23.244620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:23.245235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:23.247652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:23.252260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:23.252748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:23.253187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:23.253948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:23.254407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:23.260377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:23.381540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:23.389524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3b04db27-913f-427e-a54f-9840ddf69985 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.149370 Sep 13 13:09:23.390118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 304/604] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:23 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:24.415151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:24.415848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:24.421986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:24.422472 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:24.422908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:24.423619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:24.424072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:24.424498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:24.558145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:24.566336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-163aa700-0a45-4825-b808-f63e923996c2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1367 microversion: 2.1 time: 0.156133 Sep 13 13:09:24.566910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 301/605] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:24 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:25.482490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:25.483009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:25.489319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.489894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.490331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.491171 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.492141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.492562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.522668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e254e78b-3382-4b24-a8a1-1fd9c6ddd106 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments/489d49cc-aa80-4ff0-b9c4-22d234cbc41b" status: 200 len: 194 microversion: 2.20 time: 0.044167 Sep 13 13:09:25.523229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 305/606] 10.222.0.72 () {60 vars in 1454 bytes} [Tue Sep 13 13:09:25 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments/489d49cc-aa80-4ff0-b9c4-22d234cbc41b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:09:25.588831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:25.589591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:25.591299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:25.591789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:25.596301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.596790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.597229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.597513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.597960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.598078 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.598419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.598540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.598848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.599118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.599565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.599982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.683472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lazy-loading 'services' on Instance uuid 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:09:25.735244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:25.742943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03072f46-9aad-4778-a358-6068c01f00d8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1558 microversion: 2.1 time: 0.158429 Sep 13 13:09:25.746709 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 302/607] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:25 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:25.767075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:25.767557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:25.773904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.774382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.774807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.775523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.776015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.776431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.856248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-97513de2-4514-4dc9-8071-baca54ec5e30 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092547 Sep 13 13:09:25.856862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 303/608] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:09:25 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:09:25.904228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-657babef-247e-4962-ad2c-443bc060abd8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments/489d49cc-aa80-4ff0-b9c4-22d234cbc41b" status: 202 len: 0 microversion: 2.20 time: 0.316343 Sep 13 13:09:25.905220 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 306/609] 10.222.0.72 () {60 vars in 1457 bytes} [Tue Sep 13 13:09:25 2022] DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments/489d49cc-aa80-4ff0-b9c4-22d234cbc41b => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 13:09:25.914969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:25.917122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:25.923466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.923992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.924430 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.925149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:25.925600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:25.926047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:25.957853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-513db802-fa24-429d-b7d4-7fd003af20a4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047984 Sep 13 13:09:25.958335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 304/610] 10.222.0.72 () {60 vars in 1343 bytes} [Tue Sep 13 13:09:25 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:09:26.851623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89044a6-3b0a-4879-9409-b492f10c1f3f", "tag": "386ff3b9-fa41-4263-8bac-4134f8136d8e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:26.862295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:26.862769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:26.863197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:26.874869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] Creating event network-changed:386ff3b9-fa41-4263-8bac-4134f8136d8e for instance e89044a6-3b0a-4879-9409-b492f10c1f3f on hv-cinder-80135 Sep 13 13:09:26.879717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-c8b89fda-3667-4b93-a91e-ca073665f253 req-f31c8d3a-b93f-4e6b-9104-6dbb86dd9d5f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033384 Sep 13 13:09:26.880502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 307/611] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:26.971710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:26.974950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:26.982165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:26.987651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:26.987651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:26.987651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:26.987651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:26.988013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:27.016025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32eaa55d-b6c6-46a5-820b-6eaf278ce641 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048537 Sep 13 13:09:27.016897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 305/612] 10.222.0.72 () {60 vars in 1343 bytes} [Tue Sep 13 13:09:26 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:09:28.028429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:28.030654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:28.037194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.037675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.039048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.039742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.040194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.040621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.069576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-98c5b2c3-9d8d-42cb-8313-fe0f36465d3c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045340 Sep 13 13:09:28.070151 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 308/613] 10.222.0.72 () {60 vars in 1343 bytes} [Tue Sep 13 13:09:28 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:28.132652 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:28.133196 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:28.139539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.140021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.140450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.141127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.141575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.142029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.167077 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:09:28.423122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f38436c1-7f75-4658-9ae2-cded16a746c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 204 len: 0 microversion: 2.20 time: 0.293962 Sep 13 13:09:28.423631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 306/614] 10.222.0.72 () {60 vars in 1280 bytes} [Tue Sep 13 13:09:28 2022] DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 13:09:28.432145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:28.432826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:28.439359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.439844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.440279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.440959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:28.441406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:28.441854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:28.572640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:28.580622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:28.582084 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:28.583219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a54f264-6970-4e3e-abb5-757978a6e54c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.155087 Sep 13 13:09:28.583772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 309/615] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:28 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:09:29.611252 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:29.611874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:29.618905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:29.619390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:29.619826 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:29.620513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:29.620967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:29.621421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:29.751642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:29.759601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:29.761029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:29.762200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-af05f431-d246-4a6d-9bf1-4d2e7bd374f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.155362 Sep 13 13:09:29.762755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 307/616] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:29 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:30.787591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:30.788721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:30.796172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:30.796663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:30.797104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:30.797833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:30.798488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:30.798918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:30.989987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:30.998876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:31.000325 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:31.001468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8446c5e-4cf5-4626-8309-f8dc2cd0a8ca tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1725 microversion: 2.20 time: 0.217932 Sep 13 13:09:31.004168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 310/617] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:30 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:31.569618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c784b1b-72d1-431c-bca7-12cc7f5aa2b8", "name": "network-vif-deleted", "tag": "80c82096-8d7e-47cb-a713-18ffef510762"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:31.579144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:31.579622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:31.580054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:31.592553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] Creating event network-vif-deleted:80c82096-8d7e-47cb-a713-18ffef510762 for instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 on hv-cinder-80135 Sep 13 13:09:31.597732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-033a22c8-e90f-45ba-98cf-d1aec27c8297 req-0a312c26-18a6-45cc-a878-50c60903a904 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031701 Sep 13 13:09:31.598653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 308/618] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:32.028708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:32.029355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:32.036133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:32.036627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:32.037069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:32.038386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:32.039375 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:32.039642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:32.075111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:32.075753 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:32.076214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:32.076661 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lazy-loading 'fault' on Instance uuid 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:09:32.119409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:32.127913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:32.129319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:32.130524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-91a71cba-85c0-4cf1-965d-d7e625a55849 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 200 len: 1371 microversion: 2.20 time: 0.105765 Sep 13 13:09:32.131074 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 311/619] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:32 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:33.161000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:33.161686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:33.169045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:33.169533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:33.169997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:33.170688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:33.171141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:33.171565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:33.184603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 HTTP/1.1 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:09:33.186275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:09:33.187918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '1c784b1b-72d1-431c-bca7-12cc7f5aa2b8'} Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:09:33.188755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:09:33.190130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:09:33.191349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:09:33.191349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e15ac491-f40b-4bca-996e-2a0fa694f15a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 404 len: 111 microversion: 2.20 time: 0.031342 Sep 13 13:09:33.191349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 309/620] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:33 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:09:33.196725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c97ea94-c8a0-4250-972f-4dad2a6b0f2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '.version_select at 0x7f15650e1a60>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:33.252122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c97ea94-c8a0-4250-972f-4dad2a6b0f2f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014748545" status: 204 len: 0 microversion: 2.20 time: 0.059335 Sep 13 13:09:33.252694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 312/621] 10.222.0.72 () {60 vars in 1262 bytes} [Tue Sep 13 13:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014748545 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 13:09:34.018654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7097118a-7e23-41c1-8dd3-8b2275bca46b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: .version_select at 0x7f15650174c0>, body: {"keypair": {"name": "tempest-keypair-618022318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiEiefSml7lPz6KGDfGmxZIQ5hBMGLJ6NqRZDC6hXjsnbZef2mJEUGp7IswWAItrgwrdOXjh45tgM4Qgq/LOVDaZZUKkiVoknHvWnOMwdGGcQTGrQtDFEQ4Ntr49R0RWQ=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:34.034253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-7097118a-7e23-41c1-8dd3-8b2275bca46b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:09:34.038858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-7097118a-7e23-41c1-8dd3-8b2275bca46b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for user fe3be97820d64f85aa4d2dbd8f3ffd33 and project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:09:34.115797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7097118a-7e23-41c1-8dd3-8b2275bca46b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.100958 Sep 13 13:09:34.117208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 310/622] 10.222.0.72 () {62 vars in 1200 bytes} [Tue Sep 13 13:09:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 13:09:36.186076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-142302386", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b1eaf98-b39c-4204-9cb2-5b574f83717c"}], "security_groups": [{"name": "tempest-securitygroup--1039024713"}], "key_name": "tempest-keypair-618022318", "user_data": "}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:36.291686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] validate_networks() for [('8b1eaf98-b39c-4204-9cb2-5b574f83717c', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:09:36.653513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:09:36.653981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:09:36.654460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:09:36.654869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:09:36.655277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:09:36.664094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:36.664569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:36.665009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:36.665732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:36.666210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:36.666636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:36.683326 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:09:36.687241 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Getting quotas for user fe3be97820d64f85aa4d2dbd8f3ffd33 and project a4e94c8248874defa3cb01d0725dfcb0. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:09:36.698637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:09:36.700919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:09:36.854180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f2f0aa90-56c2-4e02-8486-44ded5a0218a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.673014 Sep 13 13:09:36.854809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 313/623] 10.222.0.72 () {62 vars in 1188 bytes} [Tue Sep 13 13:09:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 13:09:36.866132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:36.866877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:36.923591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:36.931585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:36.932933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:36.934089 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbdac685-03d8-4c90-9d5d-47fa58b2bf0c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1280 microversion: 2.20 time: 0.072092 Sep 13 13:09:36.934802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 311/624] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:36 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:37.959854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:37.960618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:37.967360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:37.968838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:37.968838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:37.969167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:37.969471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:37.969993 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:38.031204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:38.040245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:38.042937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:38.042937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-186e723b-9d8e-4607-aa00-dc38671e86b8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1276 microversion: 2.20 time: 0.087647 Sep 13 13:09:38.043335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 314/625] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:37 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:39.068654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:39.070553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:39.077945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:39.078434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:39.078873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:39.079576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:39.080034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:39.080469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:39.161428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:39.167802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:39.169228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:39.170354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a40803f-bf42-4c36-bb2d-eaae8f31b7e4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1338 microversion: 2.20 time: 0.105976 Sep 13 13:09:39.170912 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 312/626] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:39 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:40.196388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:40.197452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:40.205247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:40.205971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:40.206424 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:40.207131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:40.207582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:40.208008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:40.416665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:40.424707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:40.426170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:40.427261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2dab3221-2be7-4e20-8d4b-91edb1d47f5f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.235015 Sep 13 13:09:40.428011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 315/627] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:40 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:40.599691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:40.611998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:40.612943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:40.613071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:40.624010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] Creating event network-changed:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:09:40.629105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b78f1fa5-4595-436d-9cac-c5979a4f7efd req-d6c98cae-0ac8-4282-9737-a81837397cad service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034402 Sep 13 13:09:40.629790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 313/628] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:41.452927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:41.453539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:41.460225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:41.460711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:41.461156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:41.461878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:41.462335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:41.462764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:41.588093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:41.596238 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:41.597719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:41.598855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-736eb48d-4f96-4ae1-8c73-846f1a227c1a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.149865 Sep 13 13:09:41.599412 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 316/629] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:41 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:42.625683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:42.626408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:42.633184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:42.633666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:42.634171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:42.634861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:42.635312 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:42.635732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:42.651344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:42.768011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:42.776396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:42.778785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:42.778949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-624914ca-2b08-4463-be13-89fbc32d598f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.158102 Sep 13 13:09:42.779505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 314/630] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:42 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:43.804169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:43.804770 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:43.811233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:43.811712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:43.812143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:43.812823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:43.813273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:43.813695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:43.939355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:43.947947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:43.949377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:43.950502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-abe6213f-b118-4d26-8bca-3aa524a73352 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.150381 Sep 13 13:09:43.951056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 317/631] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:43 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:44.976857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:44.977470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:44.984372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:44.984854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:44.985420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:44.986152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:44.986606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:44.987031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:45.116341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:45.125300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:45.126092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:45.127187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-538ef5e5-cc1e-4461-9d87-a525b05ba514 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.155080 Sep 13 13:09:45.127767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 315/632] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:44 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:46.151741 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:46.152382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:46.158796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:46.159277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:46.159712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:46.160400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:46.160853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:46.161279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:46.290054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:46.298103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:46.299543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:46.300640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb719fd1-7fec-4f1b-94fe-42c005e54945 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.152786 Sep 13 13:09:46.301190 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 318/633] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:46 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:47.012068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "name": "network-vif-plugged", "status": "completed", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:47.017436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:47.023232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:47.023712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:47.024143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:47.034834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] Creating event network-vif-plugged:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:09:47.040197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6fd18fa7-01ad-4469-b018-ba53c721ac45 req-cc3e585e-90c4-48e0-88be-a64cea523b21 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Sep 13 13:09:47.042175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 316/634] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:47.326061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:47.326764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:47.328975 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:47.329851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:47.336851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:47.336851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:47.336851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:47.337324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:47.337520 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:47.337979 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:47.353632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:47.504398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:47.513010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:47.514481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:47.515586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-179202e4-8f4b-4c2f-b7e1-71bd5e96458b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.193543 Sep 13 13:09:47.516143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 319/635] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:47 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:48.542212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:48.542828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:48.549168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:48.549657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:48.550119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:48.550810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:48.551363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:48.551786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:48.682255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:48.690302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:48.691730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:48.692824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4284f124-10a5-41dc-b576-741ceadebba5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1406 microversion: 2.20 time: 0.156348 Sep 13 13:09:48.693373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 317/636] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:48 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:49.718279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:49.718914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:49.725640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:49.726202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:49.726637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:49.727326 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:49.727776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:49.728200 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:49.853092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:49.861308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:49.862795 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:49.863928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-248f9b35-8917-46a1-a2c3-a85581d34709 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1599 microversion: 2.20 time: 0.149509 Sep 13 13:09:49.864480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 320/637] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:09:49 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:09:49.890447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:49.890970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:49.893509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:49.898291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:49.898790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:49.899228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:49.899967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:49.900421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:49.900847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:49.982488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-793c5c99-48af-412f-bdd9-a18207a46a8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096100 Sep 13 13:09:49.983084 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 318/638] 10.222.0.72 () {60 vars in 1316 bytes} [Tue Sep 13 13:09:49 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:09:51.208375 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:51.218386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:51.218863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:51.219301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:51.230141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] Creating event network-changed:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:09:51.235246 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-aa6a5b59-fab0-4468-b49f-3842d768a140 req-4f1bf377-d116-463a-96f1-952976ed4821 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Sep 13 13:09:51.236007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 321/639] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:55.727818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:55.730333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:55.736328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:55.736815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:55.737251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:55.737980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:55.738441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:55.738864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:55.769141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3dc8ca24-07cb-4c1a-a823-109379190eef tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046324 Sep 13 13:09:55.769696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 319/640] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:09:55 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:09:55.838313 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:55.838899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:55.841286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:09:55.846169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:55.846658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:55.847091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:55.847775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:55.848227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:55.848647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:55.874510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:09:56.176537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a85ce51d-35ed-456d-a774-36f72c32e313 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 204 len: 0 microversion: 2.1 time: 0.342273 Sep 13 13:09:56.177139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 322/641] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:09:55 2022] DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:09:56.185523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:56.186176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:56.192316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:56.192808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:56.193318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:56.194042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:56.194563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:56.195254 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:56.483755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:56.491384 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6663bc2a-327e-40b9-bde8-961dcbe085a3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1674 microversion: 2.1 time: 0.309897 Sep 13 13:09:56.491956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 320/642] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:56 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1674 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:57.515210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:57.515830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:57.522319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:57.522806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:57.523262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:57.523957 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:57.524414 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:57.524843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:57.702101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:57.709848 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2043de1-8b06-4cd0-8641-c7595ccfed28 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1674 microversion: 2.1 time: 0.198935 Sep 13 13:09:57.710410 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 323/643] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:57 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:57.985797 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:57.986290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:57.992795 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:57.993298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:57.993732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:57.994452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:57.994920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:57.995321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:58.078589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'services' on Instance uuid e055f96e-b9e5-4957-a7cb-b962a0868dbd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:09:58.329638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d3e94c7d-e54e-4a1d-8975-e5eae4ca2f20 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments/4810de91-96cb-4df7-873e-95cccb8e013b" status: 202 len: 0 microversion: 2.1 time: 0.347636 Sep 13 13:09:58.330279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 321/644] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:09:57 2022] DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments/4810de91-96cb-4df7-873e-95cccb8e013b => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:09:58.339929 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:58.342562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:58.349182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:58.349765 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:58.350485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:58.351199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:58.351673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:58.352336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:58.382078 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-53245f68-be9e-43d1-8cb3-008b902c8efe tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Sep 13 13:09:58.382634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 324/645] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:09:58 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:58.735070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:58.735784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:58.742140 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:58.743290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:58.743793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:58.744448 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:58.744923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:58.745392 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:58.964074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:09:58.985595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-df5388bd-e0b5-4172-b33f-fb08b5145c43 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1674 microversion: 2.1 time: 0.255066 Sep 13 13:09:58.986220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 322/646] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:09:58 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:09:59.394893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:09:59.397006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:09:59.405095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:59.405612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:59.406830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:59.407562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:59.408026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:59.408456 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:59.444806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e99899c-6d00-4154-a67d-f538adf56da3 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053753 Sep 13 13:09:59.446438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 325/647] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:09:59 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:09:59.495522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9571f561-e164-4b23-8ffe-8fc0cfcb7321", "name": "network-vif-deleted", "tag": "ced03e29-9082-4781-9cd3-50d8f96acb9e"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:09:59.505719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:09:59.506229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:09:59.506662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:09:59.521319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] Creating event network-vif-deleted:ced03e29-9082-4781-9cd3-50d8f96acb9e for instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 on hv-cinder-80135 Sep 13 13:09:59.527155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b3ed9082-9da1-4415-807e-bd1a4dcdabf2 req-93b89945-9308-4a17-9cee-f8cf5e62da7d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037430 Sep 13 13:09:59.528633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 323/648] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:00.009763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:00.010591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:00.017455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.017990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.018605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.019492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.019960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.020617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.053904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.054365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.054834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.055806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lazy-loading 'fault' on Instance uuid 9571f561-e164-4b23-8ffe-8fc0cfcb7321 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:00.100952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:00.111493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48dd19ef-0f41-46b5-8297-d9f4f68d433c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 200 len: 1327 microversion: 2.1 time: 0.105472 Sep 13 13:10:00.112199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 326/649] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:00 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:00.458992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:00.462002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:00.468432 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.468927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.469366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.470093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.470578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.471180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.500137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2bedb67-ee87-45e9-a6e4-fadcbeab0e80 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045528 Sep 13 13:10:00.500686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 324/650] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:10:00 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:10:00.590071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:00.590644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:00.597181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.597672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.598145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.598843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.599295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.599718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.627119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:10:00.901788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-00cbc2a5-1d40-4af0-87c0-bee0a6b3dd8e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 204 len: 0 microversion: 2.1 time: 0.315880 Sep 13 13:10:00.902514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 327/651] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:10:00 2022] DELETE /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:10:00.910708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:00.911307 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:00.918242 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.918727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.919158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:00.919838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:00.920283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:00.920702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:01.050169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:01.058480 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c822629-2bf0-473a-aea4-41d2ec86e7f2 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1690 microversion: 2.1 time: 0.151628 Sep 13 13:10:01.059043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 325/652] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:00 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:01.135107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:01.135806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:01.141817 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:01.142299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:01.142736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:01.143429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:01.143885 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:01.144319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:01.157530 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 HTTP/1.1 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:10:01.159100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:10:01.160697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '9571f561-e164-4b23-8ffe-8fc0cfcb7321'} Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:01.161805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:10:01.163559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:01.165563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:01.165563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f844fd7f-d667-4a28-b301-767d8843cc34 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 404 len: 111 microversion: 2.1 time: 0.029709 Sep 13 13:10:01.165563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 328/653] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:01 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:10:01.170130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fadcb9bf-8769-4a6f-8bc5-5a0bfa7bde11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '.version_select at 0x7f1565017310>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:01.229538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fadcb9bf-8769-4a6f-8bc5-5a0bfa7bde11 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905609902" status: 202 len: 0 microversion: 2.1 time: 0.063146 Sep 13 13:10:01.230149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 326/654] 10.222.0.72 () {58 vars in 1218 bytes} [Tue Sep 13 13:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905609902 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:10:01.984049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d3fbb851-f502-412b-b56f-c55f380c30c2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: .version_select at 0x7f15650ce310>, body: {"keypair": {"name": "tempest-keypair-1116904173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjFognOHLaV+eiVdWDiiPexM++fDLk46rSQMu9yYCw3UDrcr9SasjUNRX2wPedjiQIJbUtw904xs+GKnhnkTxLzPTi0EZST78sahBExl6L5vpbPyV4Jz2CTjaX3Kk5ibA=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:01.999515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-d3fbb851-f502-412b-b56f-c55f380c30c2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for project 75f6274158934ab5abf68951902f1e81. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:10:02.003390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-d3fbb851-f502-412b-b56f-c55f380c30c2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for user 7b1c15ff53e5442881b56bf504b9a31b and project 75f6274158934ab5abf68951902f1e81. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:10:02.081304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:02.081938 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:02.086730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d3fbb851-f502-412b-b56f-c55f380c30c2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105829 Sep 13 13:10:02.087334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 329/655] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:10:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:02.089805 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:02.090289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:02.090716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:02.091404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:02.091853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:02.092273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:02.224249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:02.232264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f79f5b2e-3b05-4031-aa11-bf9360ad0b94 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1690 microversion: 2.1 time: 0.154823 Sep 13 13:10:02.232835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 327/656] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:02 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:03.256874 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:03.257490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:03.264702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:03.265465 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:03.266018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:03.267236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:03.267703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:03.268143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:03.401004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:03.408790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ddefa6a0-52f1-4187-9f4c-cdd80713d15e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1690 microversion: 2.1 time: 0.156346 Sep 13 13:10:03.409371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 330/657] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:03 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:04.321162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1014463354", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6ee3a0-91e5-4300-8f53-c3332833b2a0"}], "security_groups": [{"name": "tempest-securitygroup--1644065953"}], "key_name": "tempest-keypair-1116904173", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:04.432425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:04.433343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:04.440328 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:04.440829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:04.441318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:04.442049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:04.442539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:04.443180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:04.448470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] validate_networks() for [('9a6ee3a0-91e5-4300-8f53-c3332833b2a0', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:10:04.770653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:04.779388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-15ec2155-549e-445b-8c63-41022e1cf023 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1690 microversion: 2.1 time: 0.351519 Sep 13 13:10:04.780191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 331/658] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:04 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1690 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:05.692105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:10:05.692564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:10:05.693026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:10:05.693436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:10:05.693885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:10:05.702572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:05.703358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:05.703479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:05.704189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:05.704641 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:05.705068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:05.722054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for project 75f6274158934ab5abf68951902f1e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:10:05.725995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Getting quotas for user 7b1c15ff53e5442881b56bf504b9a31b and project 75f6274158934ab5abf68951902f1e81. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:10:05.738076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:10:05.740377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:10:05.803250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:05.804038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:05.811738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:05.812231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:05.812683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:05.813386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:05.813977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:05.814415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:05.859936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59e9fc27-0097-4372-8df8-c2fb65864121 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.542942 Sep 13 13:10:05.860587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 328/659] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:10:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:10:05.878959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e366ba8d-49ca-4cc3-8849-e1b78ea8a711 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:05.879674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e366ba8d-49ca-4cc3-8849-e1b78ea8a711 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:05.998496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e366ba8d-49ca-4cc3-8849-e1b78ea8a711 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:06.005725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e366ba8d-49ca-4cc3-8849-e1b78ea8a711 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1238 microversion: 2.1 time: 0.137248 Sep 13 13:10:06.006449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 329/660] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:05 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:06.100848 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:06.120332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a04839f8-af24-42a1-a52d-4f20318bda2f tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1690 microversion: 2.1 time: 0.312419 Sep 13 13:10:06.120332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 332/661] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:05 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1690 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:06.440264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e055f96e-b9e5-4957-a7cb-b962a0868dbd", "name": "network-vif-deleted", "tag": "1cd2a580-87ce-44ee-b219-d7868153c645"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:06.461448 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:06.466479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:06.466479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:06.474822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] Creating event network-vif-deleted:1cd2a580-87ce-44ee-b219-d7868153c645 for instance e055f96e-b9e5-4957-a7cb-b962a0868dbd on hv-cinder-80135 Sep 13 13:10:06.483372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-825676d0-778c-48ca-8553-4a2925bc2f40 req-049c412c-2503-4464-93e0-6571810aa356 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046589 Sep 13 13:10:06.484326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 330/662] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:07.030792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:07.031438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:07.038552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:07.040052 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:07.040502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:07.041215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:07.041674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:07.045719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:07.106093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:07.113782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9b244f17-8e0c-4620-93ee-1177929bc467 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1242 microversion: 2.1 time: 0.087380 Sep 13 13:10:07.125759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 333/663] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:07 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:07.136138 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:07.136903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:07.143128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:07.143618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:07.144060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:07.144792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:07.145258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:07.145685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:07.184324 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:07.184836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:07.185278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:07.185752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'fault' on Instance uuid e055f96e-b9e5-4957-a7cb-b962a0868dbd {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:07.231970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:07.240197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-27f3f999-f22c-4573-98e1-7a8ccb47d365 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 200 len: 1335 microversion: 2.1 time: 0.108349 Sep 13 13:10:07.240772 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 331/664] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:07 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:08.138473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:08.139167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:08.146793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:08.147400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:08.148388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:08.149314 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:08.149870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:08.150306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:08.218291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:08.220622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:08.226794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ac7f2f-bf6e-4b9e-8c38-19d38bcc1147 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1290 microversion: 2.1 time: 0.092336 Sep 13 13:10:08.227360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 334/665] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:08 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:08.264114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:08.264720 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e055f96e-b9e5-4957-a7cb-b962a0868dbd] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:08.271680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:08.272190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:08.272623 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:08.273434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:08.273976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:08.274416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:08.288186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] HTTP exception thrown: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Request method failure captured: Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd HTTP/1.1 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIASKZPtsIVlBDGq0ZWz3eFJS9tbLg_35fH1gurhTIAWQfK20jXGlxDguI8j7D_XlJMoUcCS1Swki_Kfq8g52gAEshJFAnSI91fMfuA2Qkpq4ha-xsqjszQs2XPOaRI0mePWSIU7GA1aBGb9s283gH_H8JCgOnAxtZkAfEGK8RXJIXw Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:10:08.290009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c15624f4312f49bb85a7a086c291d157", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 8c688fff323943b3bbcbb0569d974d0a Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. Sep 13 13:10:08.291626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'e055f96e-b9e5-4957-a7cb-b962a0868dbd'} Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:08.292590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. Sep 13 13:10:08.296449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:08.298075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Returning 404 to user: Instance e055f96e-b9e5-4957-a7cb-b962a0868dbd could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:08.298075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c5de505b-0de0-41c2-8d00-8efdb8c535e7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd" status: 404 len: 111 microversion: 2.1 time: 0.031114 Sep 13 13:10:08.298075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 332/666] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:08 2022] GET /compute/v2.1/servers/e055f96e-b9e5-4957-a7cb-b962a0868dbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:10:08.302756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a518d08-8af3-4cbd-85b0-3e65aed1af39 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '.version_select at 0x7f156506cee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:08.394301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a518d08-8af3-4cbd-85b0-3e65aed1af39 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508786306" status: 202 len: 0 microversion: 2.1 time: 0.089777 Sep 13 13:10:08.394301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 335/667] 10.222.0.72 () {58 vars in 1221 bytes} [Tue Sep 13 13:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508786306 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:10:09.250627 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:09.251541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:09.257629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:09.258159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:09.258579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:09.259398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:09.259935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:09.261115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:09.355689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:09.365104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4f5b1ceb-1d60-415c-a956-752a88bfe320 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1296 microversion: 2.1 time: 0.118185 Sep 13 13:10:09.378577 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 333/668] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:09 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1296 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:10.319682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:10.320185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:10.326161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:10.326646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:10.327083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:10.327792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:10.328268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:10.328693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:10.352281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-22913f28-2810-42b4-ab4e-824d82f55847 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/ips" status: 200 len: 150 microversion: 2.1 time: 0.094440 Sep 13 13:10:10.357771 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 336/669] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:10:10 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/ips => generated 150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:10.389330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:10.390102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:10.397018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:10.397599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:10.398245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:10.399055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:10.399741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:10.400258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:10.586922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:10.595233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0227a150-7a48-4423-a9d3-c57aa1303ab0 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.209845 Sep 13 13:10:10.595804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 334/670] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:10 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:10.841116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec3a98d-7f9d-4145-b596-02b4b7868127", "tag": "9c44e815-baec-4fbf-899a-28661f1fa44a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:10.853092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:10.853600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:10.854037 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:10.866226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] Creating event network-changed:9c44e815-baec-4fbf-899a-28661f1fa44a for instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 on hv-cinder-80135 Sep 13 13:10:10.874309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-09265a8f-411e-4f60-b526-f845898b93ef req-b4c911c1-8ba4-4b15-9c5b-8a05f4043b09 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034612 Sep 13 13:10:10.874309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 337/671] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:11.618743 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:11.619403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:11.626301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:11.626713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:11.627144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:11.627847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:11.628295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:11.628710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:11.882981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:11.886065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:11.892012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d186e7ad-b62d-4fcf-9060-ca4e0c107df2 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.277217 Sep 13 13:10:11.892576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 335/672] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:11 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:12.079138 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:12.079719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:12.082319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:12.086395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28216743-d1f4-40a9-8aa4-04f3cfb55d5f"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:12.087288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.087772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.088480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.089091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.089176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:12.089484 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.089937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.095408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.095989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.096417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.097097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.097548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.097989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.115332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:10:12.318728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c84a80eb-2f0d-48ba-a215-fb6eb81fff2d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 204 len: 0 microversion: 2.1 time: 0.243495 Sep 13 13:10:12.319306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 338/673] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:10:12 2022] DELETE /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:10:12.327795 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:12.329723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:12.334426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.334915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.335383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.336075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.336538 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.336965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.465002 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:12.472690 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5f854829-4754-40b8-9763-35697d79fe74 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1507 microversion: 2.1 time: 0.148765 Sep 13 13:10:12.474438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 339/674] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:12 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:12.916292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:12.916292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:12.922922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.923430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.923923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:12.924564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:12.925025 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:12.925458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:13.056277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:13.064391 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c5d07ada-f8b2-4b87-ae17-59b07a83e6bc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.152983 Sep 13 13:10:13.064954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 340/675] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:12 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:13.497417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:13.498072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:13.504482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:13.504974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:13.505419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:13.506159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:13.506621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:13.507054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:13.634756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:13.643015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d88bde4e-bda4-489f-b809-e76a42f72306 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1507 microversion: 2.1 time: 0.150493 Sep 13 13:10:13.643583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 341/676] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:13 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:14.088808 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:14.089437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:14.095409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:14.095894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:14.096331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:14.097018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:14.097474 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:14.097923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:14.224527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:14.233227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7432d2f3-9abf-4913-94d3-b89f6336884e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.148786 Sep 13 13:10:14.233850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 342/677] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:14 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:14.666606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:14.667247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:14.673555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:14.674082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:14.674519 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:14.675208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:14.675662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:14.676091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:14.806112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:14.814441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ce17605-b1ac-44c9-a4a2-52a45b98218a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1507 microversion: 2.1 time: 0.152334 Sep 13 13:10:14.815005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 343/678] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:14 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:15.258187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:15.259077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:15.266552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:15.267134 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:15.267651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:15.268483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:15.269001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:15.269698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:15.484698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:15.492793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d535ce33-8d92-40b2-80aa-eb8f87444170 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.240018 Sep 13 13:10:15.493636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 344/679] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:15 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:15.569133 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-08cfc33c-fef7-4c2a-aecf-07dc22a10f66 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.486892 Sep 13 13:10:15.570572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 336/680] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:10:12 2022] POST /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments => generated 194 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:10:15.838751 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:15.839803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:15.847227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:15.847936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:15.848579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:15.849590 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:15.850307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:15.850838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:15.922393 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:15.926579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11dc092-73fb-4122-9cea-7a41398c3c66", "name": "network-vif-deleted", "tag": "9537de83-a92f-4647-a5d6-285071c8be74"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:15.937659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:15.938190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:15.938620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:15.944109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:15.950385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] Creating event network-vif-deleted:9537de83-a92f-4647-a5d6-285071c8be74 for instance e11dc092-73fb-4122-9cea-7a41398c3c66 on hv-cinder-80135 Sep 13 13:10:15.951870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1c00a40a-1363-4688-8e17-ba8a0d2ab048 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1465 microversion: 2.1 time: 0.118170 Sep 13 13:10:15.952449 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 345/681] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:15 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1465 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:15.967987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-ce21eee3-0bf6-4a29-88c2-00069aadbd9c req-a4b45894-f9ea-4869-9eaf-5307fc3e95eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046297 Sep 13 13:10:15.968667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 337/682] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:10:16.516869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:16.517427 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:16.523334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:16.523805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:16.524248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:16.524947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:16.525406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:16.525867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:16.659083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:16.667126 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d036836-856a-4156-b7a0-6a35b21aa556 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.154129 Sep 13 13:10:16.669820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 346/683] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:16 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:16.973426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:16.977664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:16.978410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:16.985594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:16.986105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:16.986539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:16.987353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:16.987849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:16.988287 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:17.023386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:17.023871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:17.024303 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:17.024861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lazy-loading 'fault' on Instance uuid e11dc092-73fb-4122-9cea-7a41398c3c66 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:17.068023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:17.076748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f7118fd3-b319-4d6b-90bc-f76b7f61e44a tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 200 len: 1311 microversion: 2.1 time: 0.104952 Sep 13 13:10:17.077302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 338/684] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:16 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:17.220849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec3a98d-7f9d-4145-b596-02b4b7868127", "name": "network-vif-plugged", "status": "completed", "tag": "9c44e815-baec-4fbf-899a-28661f1fa44a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:17.230957 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:17.231442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:17.231878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:17.242941 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] Creating event network-vif-plugged:9c44e815-baec-4fbf-899a-28661f1fa44a for instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 on hv-cinder-80135 Sep 13 13:10:17.248419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-308bfb07-b626-4505-aa9f-ea5a7b3356bf req-e0d2ceec-6879-4cdc-abb0-d94fefeaa0e9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031270 Sep 13 13:10:17.249000 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 347/685] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:17.690718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:17.691326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:17.697259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:17.697764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:17.698234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:17.698909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:17.699359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:17.699782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:17.829582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:17.837292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2287589e-bd4e-4a6d-84f8-8ccdeceb4367 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.150434 Sep 13 13:10:17.837873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 339/686] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:17 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:18.100050 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:18.100754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: e11dc092-73fb-4122-9cea-7a41398c3c66] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:18.107894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.108385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.108830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.109524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.110022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.110457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.123488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] HTTP exception thrown: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Request method failure captured: Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 HTTP/1.1 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIASKZPtsIVlBDGq0ZWz3eFJS9tbLg_35fH1gurhTIAWQfK20jXGlxDguI8j7D_XlJMoUcCS1Swki_Kfq8g52gAEshJFAnSI91fMfuA2Qkpq4ha-xsqjszQs2XPOaRI0mePWSIU7GA1aBGb9s283gH_H8JCgOnAxtZkAfEGK8RXJIXw Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:10:18.126485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c15624f4312f49bb85a7a086c291d157", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 8c688fff323943b3bbcbb0569d974d0a Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. Sep 13 13:10:18.127806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'e11dc092-73fb-4122-9cea-7a41398c3c66'} Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:18.128546 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. Sep 13 13:10:18.129672 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:18.131470 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Returning 404 to user: Instance e11dc092-73fb-4122-9cea-7a41398c3c66 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:18.131470 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3e63d9ca-833d-43d7-b288-505ee739dc6d tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66" status: 404 len: 111 microversion: 2.1 time: 0.030701 Sep 13 13:10:18.131470 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 348/687] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:18 2022] GET /compute/v2.1/servers/e11dc092-73fb-4122-9cea-7a41398c3c66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:10:18.134857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:18.135355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:18.142423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.142907 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.143346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.144037 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.144558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.144925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.170745 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:10:18.461840 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06db6989-8905-43e6-8f57-026cc9fbd7d5 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 204 len: 0 microversion: 2.1 time: 0.330426 Sep 13 13:10:18.462426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 340/688] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:10:18 2022] DELETE /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:10:18.471432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:18.472090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:18.478662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.479157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.479710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.480830 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.481292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.481775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.613123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:18.621678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ae50db8-6b93-4c73-92cb-97b1414789dd tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.154034 Sep 13 13:10:18.622270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 349/689] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:18 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:18.861115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:18.861887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:18.867784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.868269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.868706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:18.869396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:18.869912 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:18.871484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:19.005013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:19.012719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-02026c7e-e79d-4a12-8f4e-0a8c23aa8d25 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.155882 Sep 13 13:10:19.013217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 341/690] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:18 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:19.645228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:19.645996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:19.652644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:19.653122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:19.653555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:19.654259 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:19.654740 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:19.655162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:19.779824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:19.787657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9727d78-833d-4004-be88-06c265081c49 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.146406 Sep 13 13:10:19.788224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 350/691] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:19 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:20.035293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:20.035878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:20.042589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:20.043070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:20.043501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:20.044182 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:20.044633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:20.045052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:20.176059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:20.184155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-57a93c30-0ebb-43fd-b7d3-3d7671ad861e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.152799 Sep 13 13:10:20.184714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 342/692] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:20 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:20.810790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:20.811400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:20.817790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:20.818276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:20.818709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:20.819388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:20.819838 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:20.820258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:20.952638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:20.960335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ea9c01cd-fedf-4eb4-8701-c4de64583a27 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.153575 Sep 13 13:10:20.960894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 351/693] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:20 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:21.207139 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:21.207747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:21.214749 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:21.215249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:21.215685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:21.216454 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:21.216835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:21.217254 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:21.342484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:21.350036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0ecb8431-4fd5-4ee3-911d-470337ec8671 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1364 microversion: 2.1 time: 0.146721 Sep 13 13:10:21.350603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 343/694] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:21 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:21.984271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:21.985035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:21.992020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:21.992519 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:21.992958 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:21.993660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:21.994143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:21.994568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:22.128592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:22.136271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1655f36a-c8e1-4fb7-9312-7ab78eddaed7 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1523 microversion: 2.1 time: 0.156333 Sep 13 13:10:22.136835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 352/695] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:21 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:22.433719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:22.434358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:22.440470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:22.440949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:22.441381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:22.442086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:22.442540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:22.442958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:22.568257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:22.576443 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dab87814-cde8-4b2f-9d46-ce8b736112dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1551 microversion: 2.1 time: 0.208046 Sep 13 13:10:22.577010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 344/696] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:22 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1551 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:22.598199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:22.598700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:22.604665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:22.605318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:22.605781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:22.606475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:22.606933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:22.607362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:22.611262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:22.729306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e39dea3a-1271-4087-ba1a-e5f6ee1663cd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135012 Sep 13 13:10:22.730591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 353/697] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:10:22 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:23.161344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:23.162292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:23.170007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:23.170500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:23.171824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:23.172881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:23.173349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:23.173819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:23.200998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8e228d-cd12-415d-be09-a5a49b6f72c7", "name": "network-vif-deleted", "tag": "ad1412c9-5963-436d-923b-0352d8bd326d"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:23.226413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:23.227254 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:23.230568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:23.248332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c688fff323943b3bbcbb0569d974d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15624f4312f49bb85a7a086c291d157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:23.253976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] Creating event network-vif-deleted:ad1412c9-5963-436d-923b-0352d8bd326d for instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 on hv-cinder-80135 Sep 13 13:10:23.256726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a924e0aa-c87b-4629-bbce-b4e96959e568 tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 200 len: 1481 microversion: 2.1 time: 0.100905 Sep 13 13:10:23.257308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 354/698] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:23 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 1481 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:23.260671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-49047839-d729-48f8-bf8f-dd089707eea5 req-461d277c-74ad-43d2-832c-3ecb7bbb59a4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127678 Sep 13 13:10:23.261549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 345/699] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:23.849398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec3a98d-7f9d-4145-b596-02b4b7868127", "tag": "9c44e815-baec-4fbf-899a-28661f1fa44a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:23.859126 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:23.859347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:23.859778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:23.871605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] Creating event network-changed:9c44e815-baec-4fbf-899a-28661f1fa44a for instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 on hv-cinder-80135 Sep 13 13:10:23.876236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-59a2ada7-58a8-4c6e-8f73-1d8181b2ce9f req-8f769169-d9d7-43f0-a574-3bde3b134f4d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030649 Sep 13 13:10:23.876998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 355/700] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:24.279269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28216743-d1f4-40a9-8aa4-04f3cfb55d5f"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:24.281532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:24.281961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:24.282829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] [instance: 4e8e228d-cd12-415d-be09-a5a49b6f72c7] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:24.286060 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:24.290690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.291156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.293432 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.293564 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.294139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.294314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.294673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.295105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.295329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.296201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.296824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.297413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.311526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] HTTP exception thrown: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Request method failure captured: Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 HTTP/1.1 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIASKZPtsIVlBDGq0ZWz3eFJS9tbLg_35fH1gurhTIAWQfK20jXGlxDguI8j7D_XlJMoUcCS1Swki_Kfq8g52gAEshJFAnSI91fMfuA2Qkpq4ha-xsqjszQs2XPOaRI0mePWSIU7GA1aBGb9s283gH_H8JCgOnAxtZkAfEGK8RXJIXw Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:10:24.313943 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c15624f4312f49bb85a7a086c291d157", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c15624f4312f49bb85a7a086c291d157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: c15624f4312f49bb85a7a086c291d157 Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-337696504 Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 8c688fff323943b3bbcbb0569d974d0a Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-337696504-project Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. Sep 13 13:10:24.317785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '4e8e228d-cd12-415d-be09-a5a49b6f72c7'} Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:24.318677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. Sep 13 13:10:24.320085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.321329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] Returning 404 to user: Instance 4e8e228d-cd12-415d-be09-a5a49b6f72c7 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:24.321790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-33047fb9-cd47-4307-83de-7092fac5648e tempest-ServerRescueNegativeTestJSON-337696504 tempest-ServerRescueNegativeTestJSON-337696504-project] 10.222.0.72 "GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7" status: 404 len: 111 microversion: 2.1 time: 0.040743 Sep 13 13:10:24.343897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 356/701] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:24 2022] GET /compute/v2.1/servers/4e8e228d-cd12-415d-be09-a5a49b6f72c7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:10:24.414415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: POST /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments HTTP/1.1 Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 74 Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:10:24.417965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {"volumeAttachment": {"volumeId": "28216743-d1f4-40a9-8aa4-04f3cfb55d5f"}} Sep 13 13:10:24.419555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'server_id': 'e89044a6-3b0a-4879-9409-b492f10c1f3f', 'body': {'volumeAttachment': {'volumeId': '28216743-d1f4-40a9-8aa4-04f3cfb55d5f'}}} Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.420409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:24.421991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:24.423436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:24.423436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:24.423436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:24.423436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f Sep 13 13:10:24.423436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:10:24.424775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 400 to user: Invalid volume: volume 28216743-d1f4-40a9-8aa4-04f3cfb55d5f is already attached to instances: e89044a6-3b0a-4879-9409-b492f10c1f3f {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:24.425998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-56cf4c48-3d42-40f6-85e3-05cd78786e31 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152374 Sep 13 13:10:24.426812 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 346/702] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:10:24 2022] POST /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:10:24.506183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:24.507086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:24.522054 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.522788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.523424 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.530229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.530229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.530229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.618673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'services' on Instance uuid e89044a6-3b0a-4879-9409-b492f10c1f3f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:24.843710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2ec888f0-f5b1-4a79-a9bd-cb69b17a02ee tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments/28216743-d1f4-40a9-8aa4-04f3cfb55d5f" status: 202 len: 0 microversion: 2.1 time: 0.341224 Sep 13 13:10:24.844628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 357/703] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:10:24 2022] DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments/28216743-d1f4-40a9-8aa4-04f3cfb55d5f => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:10:24.854086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:24.856730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:24.864689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.865187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.865611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.866338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:24.866781 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:24.867201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:24.899958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8e0622a-ae98-4456-9b46-79073d97c6f7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050870 Sep 13 13:10:24.900523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 347/704] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:10:24 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:25.914298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:25.916867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:25.927822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:25.927822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:25.927822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:25.935463 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:25.936176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:25.936796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:25.973761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f7c64cef-9b92-4527-8463-cf13cfa3850c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064683 Sep 13 13:10:25.974330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 358/705] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:10:25 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 13:10:26.051600 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:26.052117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:26.055995 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:26.060515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:26.061252 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:26.061900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:26.062813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:26.063281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:26.063713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:26.091799 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:10:26.226398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:26.382929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5dd23606-22dd-457c-953c-61914ec9307a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 204 len: 0 microversion: 2.1 time: 0.334830 Sep 13 13:10:26.384015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 348/706] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:10:26 2022] DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:10:26.393875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:26.394797 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:26.401537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:26.402493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:26.403232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:26.404673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:26.405250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:26.405811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:26.560612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:26.568536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0d1c200e-e85b-45cc-b930-f53e62c9c85a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1682 microversion: 2.1 time: 0.179902 Sep 13 13:10:26.571554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 359/707] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:26 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:27.363435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:27.364997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:27.369861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:27.370404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:27.370841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:27.371767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:27.372238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:27.372651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:27.399761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dba60b4-3a97-415b-9193-096dbecb0f94 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/ips" status: 200 len: 152 microversion: 2.20 time: 0.099327 Sep 13 13:10:27.401273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 349/708] 10.222.0.72 () {60 vars in 1289 bytes} [Tue Sep 13 13:10:27 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/ips => generated 152 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 13:10:27.594765 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:27.598023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:27.607250 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:27.608044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:27.609768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:27.610710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:27.611363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:27.612005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:27.768027 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:27.777165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c02338b2-328b-4eac-85b2-d6f5bb6bdf14 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1682 microversion: 2.1 time: 0.185663 Sep 13 13:10:27.779207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 360/709] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:27 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:28.804409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:28.805143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:28.812442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:28.813799 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:28.813799 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:28.814246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:28.814696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:28.815149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:28.904800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:28.913048 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fad1bf4a-1ec1-4008-9a66-5577a0e0af7d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1615 microversion: 2.1 time: 0.112418 Sep 13 13:10:28.913636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 350/710] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:28 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:29.116461 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89044a6-3b0a-4879-9409-b492f10c1f3f", "name": "network-vif-deleted", "tag": "386ff3b9-fa41-4263-8bac-4134f8136d8e"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:29.129168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:29.130013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:29.130633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:29.143464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] Creating event network-vif-deleted:386ff3b9-fa41-4263-8bac-4134f8136d8e for instance e89044a6-3b0a-4879-9409-b492f10c1f3f on hv-cinder-80135 Sep 13 13:10:29.148950 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d5438700-e878-46ee-a0ab-6228d2ff49a2 req-bbe357f4-849d-4feb-8190-b946e1568f59 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Sep 13 13:10:29.154914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 361/711] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:29.938244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:29.940400 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:29.945407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:29.945890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:29.946335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:29.947036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:29.947494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:29.947919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:29.984444 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:29.984947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:29.985382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:29.986034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'fault' on Instance uuid e89044a6-3b0a-4879-9409-b492f10c1f3f {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:30.039707 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:30.049363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b76727aa-d066-47aa-90c9-1e1b50ffb430 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 200 len: 1332 microversion: 2.1 time: 0.115091 Sep 13 13:10:30.050081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 351/712] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:29 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:30.224569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:30.225323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:30.237996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:30.242322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:30.242322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:30.242322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:30.242322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:30.242725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:30.281007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lazy-loading 'flavor' on Instance uuid f7f227ce-e8db-4805-9bcf-42485773201f {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:30.828107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-467911e9-34b1-42f3-a44e-8025c4778d82 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/action" status: 202 len: 0 microversion: 2.20 time: 0.613993 Sep 13 13:10:30.828908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 362/713] 10.222.0.72 () {62 vars in 1319 bytes} [Tue Sep 13 13:10:30 2022] POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:10:30.837572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:30.840129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:30.844235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:30.844722 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:30.845155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:30.845862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:30.846375 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:30.846803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:30.977299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:30.986667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:30.988089 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:30.989250 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-32a19233-5234-4785-ae79-27986044673f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.155646 Sep 13 13:10:30.989830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 352/714] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:30 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:31.078511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:31.079218 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:31.085504 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:31.086024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:31.086476 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:31.087178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:31.087637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:31.088125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:31.102339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f HTTP/1.1 Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:10:31.104386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:10:31.108728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'e89044a6-3b0a-4879-9409-b492f10c1f3f'} Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:10:31.109475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:10:31.110752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:10:31.112019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:10:31.112019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-622969e1-38f5-42af-8e57-68374ac26ab5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 404 len: 111 microversion: 2.1 time: 0.032512 Sep 13 13:10:31.112019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 363/715] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:31 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:10:31.115892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-199a519c-3c2b-454e-b2eb-0815074c3d11 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '.version_select at 0x7f1564f6f9d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:31.183638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-199a519c-3c2b-454e-b2eb-0815074c3d11 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653457710" status: 202 len: 0 microversion: 2.1 time: 0.070661 Sep 13 13:10:31.184302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 353/716] 10.222.0.72 () {58 vars in 1221 bytes} [Tue Sep 13 13:10:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653457710 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:10:31.992487 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f157bd83-cdba-4e7c-98ba-542ae110c16a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: .version_select at 0x7f156677c0d0>, body: {"keypair": {"name": "tempest-keypair-1684107212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMr509hVbwJYSzTr/tbPNkX3Jm0kq5tsFNbeG4qPuxz+4l6+15+NN+lsQjM4xIGQm9g7zKMBsaEoRDDPqGG+zIDaNUpj6WXr3X0MCSqwmIlSmniNYc9sbWoudMZMuYNvGw=="}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:32.009529 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-f157bd83-cdba-4e7c-98ba-542ae110c16a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:10:32.014501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-f157bd83-cdba-4e7c-98ba-542ae110c16a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'key_pairs'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:10:32.020826 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:32.021440 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:32.029901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:32.030412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:32.030863 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:32.031574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:32.032029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:32.032646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:32.103093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f157bd83-cdba-4e7c-98ba-542ae110c16a tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114387 Sep 13 13:10:32.103701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 364/717] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:10:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:32.166641 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:32.175499 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:32.176924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:32.178105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4fb5b5d6-dd0d-4cfe-8ab3-ddbbc0d7247d tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.161596 Sep 13 13:10:32.178663 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 354/718] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:32 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:10:33.203695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:33.204617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:33.212080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:33.212650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:33.213168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:33.214972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:33.215556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:33.216045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:33.664448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:33.684087 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:33.687055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:33.689535 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36dfabf5-aaa9-4b01-9a5b-d9ada6b7b6c2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.489906 Sep 13 13:10:33.690353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 365/719] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:33 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:34.316452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1539249896", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f0b8231-ada5-4945-87a4-d1b052328819"}], "security_groups": [{"name": "tempest-securitygroup--325274770"}], "key_name": "tempest-keypair-1684107212", "user_data": "}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:34.456893 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] validate_networks() for [('1f0b8231-ada5-4945-87a4-d1b052328819', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:10:34.715651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:34.717959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:34.725071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:34.728642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:34.728642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:34.728642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:34.728642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:34.729266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:34.992581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:35.001706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:35.003377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:35.004560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-28e38b19-eaa9-44bb-b5a8-463006c92c28 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.293521 Sep 13 13:10:35.005482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 366/720] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:34 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:35.082999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:10:35.083538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:10:35.084035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:10:35.084462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:10:35.084947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:10:35.095996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:35.096716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:35.097171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:35.098274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:35.098742 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:35.099198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:35.120232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:10:35.124517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Getting quotas for user 9fadb80f21614816b3526d59b2d8a0f7 and project 7775bd9f19b64c8ca07407c103dcff9b. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:10:35.137620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:10:35.140836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:10:35.329830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4b210176-034e-425a-8efb-34e20b00629e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.017689 Sep 13 13:10:35.331682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 355/721] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:10:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:10:35.343708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-93dbde5d-e17d-4f98-ad57-1261e1e91627 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:35.344411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-93dbde5d-e17d-4f98-ad57-1261e1e91627 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:35.407505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-93dbde5d-e17d-4f98-ad57-1261e1e91627 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:35.419093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-93dbde5d-e17d-4f98-ad57-1261e1e91627 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1242 microversion: 2.1 time: 0.079958 Sep 13 13:10:35.419999 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 367/722] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:35 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:36.030945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:36.031563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:36.038643 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:36.039130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:36.040490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:36.040490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:36.040692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:36.041099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:36.175105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:36.187237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:36.188658 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:36.189896 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dbdbf6bc-639e-4c4b-9aa0-cef8511840d8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.163511 Sep 13 13:10:36.190598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 356/723] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:36 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:36.442352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:36.442971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:36.457981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:36.457981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:36.457981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:36.457981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:36.458417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:36.458417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:36.517714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:36.525490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ef06f349-5c2f-4859-b44e-95da6cdd7708 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1246 microversion: 2.1 time: 0.087084 Sep 13 13:10:36.526174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 368/724] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:36 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:37.216207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:37.216800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:37.223273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:37.223755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:37.224187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:37.224873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:37.225319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:37.225761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:37.455290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:37.463387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:37.466162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:37.480404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-59505e1d-d409-413d-8daa-17be5a28d480 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.255417 Sep 13 13:10:37.480404 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 357/725] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:37 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:37.549218 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:37.550415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:37.558144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:37.558631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:37.559214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:37.559750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:37.560201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:37.560727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:37.653951 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:37.662214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-bb41e374-68fd-462d-a0a9-6d516e5ad135 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1312 microversion: 2.1 time: 0.116926 Sep 13 13:10:37.662790 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 369/726] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:37 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:38.494478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:38.495866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:38.502582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:38.506953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:38.506953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:38.506953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:38.506953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:38.507426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:38.690718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:38.691370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:38.698020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:38.698635 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:38.699127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:38.699828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:38.700283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:38.700709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:38.706199 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:38.716750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:38.718307 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:38.719665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2112ef0e-5ae4-4df5-bee5-207e8703ded4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.229054 Sep 13 13:10:38.720290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 358/727] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:38 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:38.874105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:38.874105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63483518-5f01-4178-8e31-738a32075f2e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.186853 Sep 13 13:10:38.874336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 370/728] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:38 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:39.256228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d00a32-cda7-4b1d-8f9f-1c0856011372", "tag": "54c2670f-bc7d-4b11-9765-a6b741484f6f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:39.267282 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:39.267909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:39.268344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:39.281525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] Creating event network-changed:54c2670f-bc7d-4b11-9765-a6b741484f6f for instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 on hv-cinder-80135 Sep 13 13:10:39.295522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-91f99614-fa6c-413e-b497-0d37782434e9 req-18cdd292-a849-410c-a592-9cb012b4d5d9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042939 Sep 13 13:10:39.296117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 359/729] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:10:39.747143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:39.747818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:39.754377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:39.754903 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:39.755349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:39.756112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:39.756575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:39.757007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:39.897609 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:39.898332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:39.898873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:39.905638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:39.908837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:39.908837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:39.908837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:39.908837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:39.909245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:39.909347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:39.909942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:39.911355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec9dd5c8-9d14-4098-af21-f05d93ce9cdc tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.168457 Sep 13 13:10:39.917616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 371/730] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:39 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:40.039784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:40.047449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-66932a15-7ee2-4a4e-933c-6fc1fbf189cd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.154706 Sep 13 13:10:40.048016 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 360/731] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:39 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:40.937831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:40.938443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:40.944841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:40.945323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:40.945884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:40.946573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:40.947057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:40.947478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:40.950653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:41.071459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:41.072101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:41.079527 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:41.080009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:41.080442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:41.081318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:41.081850 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:41.082274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:41.098960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:41.107648 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:41.109080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:41.110267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcb84496-4b5d-45cd-95dc-a102b0d46846 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.176530 Sep 13 13:10:41.110822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 372/732] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:40 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:41.210098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:41.218195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d64c3dd-046b-4f33-b624-9e620c713027 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.151278 Sep 13 13:10:41.218749 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 361/733] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:41 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:42.135399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:42.136292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:42.143374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:42.143865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:42.144307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:42.145029 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:42.145517 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:42.145979 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:42.240221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:42.240842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:42.247845 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:42.248342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:42.248779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:42.249481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:42.249965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:42.250393 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:42.356738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:42.364865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:42.366346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:42.367505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-21985632-db9b-4e37-b8bd-4c63751c08cf tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.236071 Sep 13 13:10:42.368243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 373/734] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:42 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:42.392337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:42.400280 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2cfb88ad-5f96-431b-a55e-0174a715caef tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.163841 Sep 13 13:10:42.400844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 362/735] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:42 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:43.392561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:43.393172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:43.399572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:43.400057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:43.400493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:43.401337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:43.401819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:43.402252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:43.423677 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:43.424385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:43.431004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:43.431602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:43.431982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:43.433485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:43.433999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:43.434426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:43.599282 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:43.606421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:43.608423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:43.609876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:43.611070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3ee4e2bb-2a00-4c32-8bd2-1fea0cbafd7b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.222486 Sep 13 13:10:43.611631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 374/736] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:43 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:43.614120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3b818da4-aaf4-4ba1-9536-30fcb4c0f9bd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.194216 Sep 13 13:10:43.614674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 363/737] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:43 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:44.637697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:44.638217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:44.638597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:44.638703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:44.644700 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:44.645191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:44.645340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:44.645634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:44.645777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:44.646139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:44.646362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:44.646809 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:44.646917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:44.647229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:44.647337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:44.647742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:44.837856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:44.841862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:44.846280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:44.847710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:44.848868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3238a7d7-e337-431c-b72d-8bacdeae5d50 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.216301 Sep 13 13:10:44.849385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-06bb91e4-523f-4fdb-8f2d-addd5cb6660b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.216521 Sep 13 13:10:44.849512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 375/738] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:44 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:44.850239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 364/739] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:44 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:45.872229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:45.872853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:45.874468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:45.874897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=6 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:45.875004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:45.876914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:45.877587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:45.880434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:45.880925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:45.881373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:45.882098 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:45.882554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:45.882760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:45.887912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:45.888088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:45.888088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:45.888088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:45.888088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:45.888417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:46.329514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:46.333636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:46.343100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f16996d6-7690-490f-92eb-044b5a66676d tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.469571 Sep 13 13:10:46.343100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 376/740] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:45 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:46.343548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:46.343679 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:46.344822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-582a4730-5509-4663-9759-95817f62eb46 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.474314 Sep 13 13:10:46.345365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 365/741] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:45 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:10:47.363653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:47.365260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:47.371655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:47.372192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:47.372631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:47.373712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:47.374196 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:47.374787 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:47.393399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d00a32-cda7-4b1d-8f9f-1c0856011372", "name": "network-vif-plugged", "status": "completed", "tag": "54c2670f-bc7d-4b11-9765-a6b741484f6f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:47.403804 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:47.404291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:47.404731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:47.415923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] Creating event network-vif-plugged:54c2670f-bc7d-4b11-9765-a6b741484f6f for instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 on hv-cinder-80135 Sep 13 13:10:47.421521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5d33d9d2-3f5c-4458-9164-cf8796ace30d req-5d6ff1f0-4373-4a44-8d85-2ce26add8c24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154774 Sep 13 13:10:47.422275 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 377/742] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:47.428283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:47.428983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:47.436160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:47.436823 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:47.437266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:47.438013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:47.438471 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:47.438928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:47.555278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:47.564683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b512e525-cfb3-4a74-99cf-eefc9243270e tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.205402 Sep 13 13:10:47.565236 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 366/743] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:47 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:47.602076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:47.610674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:47.612197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:47.613353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2028584a-5421-41bc-bfc7-b1721a635a14 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.189856 Sep 13 13:10:47.613942 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 378/744] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:47 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:48.589010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:48.589616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:48.596081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:48.596565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:48.596999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:48.597676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:48.598151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:48.598570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:48.640094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:48.640716 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:48.647409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:48.647910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:48.648355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:48.649065 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:48.649523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:48.649981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:48.782008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:48.784091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:48.791314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3ff4e51-5034-48d5-955d-fc55b5eeda1c tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1367 microversion: 2.1 time: 0.206606 Sep 13 13:10:48.792403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 367/745] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:48 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:48.808632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:48.816694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:48.818139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:48.819310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b5b9823-eb29-4084-afac-5ba112f01e8a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.183192 Sep 13 13:10:48.819847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 379/746] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:48 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:49.283778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:49.284299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:49.291181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.291607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.292538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.293220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.293667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.294110 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.317034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lazy-loading 'flavor' on Instance uuid d54284e3-c8b5-4ca1-8fba-355677093187 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:10:49.516402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52676f20-1133-4b52-a569-72ee871e7dac tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "POST /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187/action" status: 202 len: 0 microversion: 2.1 time: 0.236325 Sep 13 13:10:49.516999 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 368/747] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:10:49 2022] POST /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:10:49.525151 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:49.526062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:49.533158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.533662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.534156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.534896 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.535421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.536155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.689256 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:49.696923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4806389-ec57-480c-9d02-300bc66196aa tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.175619 Sep 13 13:10:49.697481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 380/748] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:49 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:49.815334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:49.815953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:49.822655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.823155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.823731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.824427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.824875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.825295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.846561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:49.847932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:49.856750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.857411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.857955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:49.858900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:49.859705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:49.860586 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:50.027414 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:50.035428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c14299b-fffe-455c-a2ec-4102eb85dfea tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1557 microversion: 2.1 time: 0.224756 Sep 13 13:10:50.036610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 369/749] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:49 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:10:50.045300 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:50.053776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:50.055606 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:50.057024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-88d395e3-8de6-47f9-ba9b-65752596ad83 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.215642 Sep 13 13:10:50.070285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 381/750] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:49 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:50.070394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:50.070394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:50.070394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:50.070394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:50.070732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:50.070732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:50.070732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:50.070732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:50.148242 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f9e6e1d-c15d-481b-b3f8-3519ca3cfca1 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092759 Sep 13 13:10:50.149802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 370/751] 10.222.0.72 () {58 vars in 1275 bytes} [Tue Sep 13 13:10:50 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:10:50.720544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:50.721242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:50.727615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:50.728179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:50.728691 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:50.729493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:50.730270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:50.730763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:50.915976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:50.923730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d25c32e1-8bff-453b-9581-6d6f5f25f698 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.207114 Sep 13 13:10:50.924843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 382/752] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:50 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:51.084352 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:51.085033 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:51.093041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:51.093531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:51.094011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:51.094710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:51.095163 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:51.095584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:51.297006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:51.318455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:51.319804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:51.320966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e2d814ed-6c99-433b-89cb-b5946f8193e0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.241214 Sep 13 13:10:51.321530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 371/753] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:51 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:51.403191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d00a32-cda7-4b1d-8f9f-1c0856011372", "tag": "54c2670f-bc7d-4b11-9765-a6b741484f6f"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:51.416445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:51.417171 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:51.417825 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:51.430800 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] Creating event network-changed:54c2670f-bc7d-4b11-9765-a6b741484f6f for instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 on hv-cinder-80135 Sep 13 13:10:51.436538 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-213529b2-1580-4aa0-b332-78bdbba89209 req-75f69322-b342-4f46-b42f-e7fd617b0542 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038785 Sep 13 13:10:51.439394 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 383/754] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:51.950667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:51.951514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:51.962036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:51.962667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:51.963193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:51.965009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:51.965206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:51.966243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:52.191387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:52.191387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7643aaa0-ff4d-4b78-a34a-e7a8d6795710 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.240284 Sep 13 13:10:52.191387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 372/755] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:51 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:52.347015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:52.347709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:52.355323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:52.355825 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:52.356286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:52.357010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:52.357658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:52.358288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:52.515235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:52.524748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:52.527776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:52.529011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b07035b1-5842-4f96-8f0b-4878462c15b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1744 microversion: 2.20 time: 0.186229 Sep 13 13:10:52.529810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 384/756] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:52 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:53.212894 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:53.213682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:53.221718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:53.222230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:53.222668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:53.223363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:53.223813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:53.224783 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:53.365216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:53.373918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-68b03a3b-0a39-4cfa-9868-d3236b8a0dc9 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.165170 Sep 13 13:10:53.374803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 373/757] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:53 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:53.554369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:53.555469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:53.562234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:53.562919 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:53.563422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:53.564128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:53.564594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:53.565030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:53.712143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:53.720912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:53.724699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:53.724699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a089e91e-4d42-499d-9b55-7ee1f4b1311e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1744 microversion: 2.20 time: 0.173120 Sep 13 13:10:53.724699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 385/758] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:53 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:54.405264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:54.405910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:54.412646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:54.413127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:54.413565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:54.414304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:54.414752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:54.415168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:54.564308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:54.572564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6ab40a70-91ff-45f8-85cf-770053f2d055 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.171501 Sep 13 13:10:54.590705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 374/759] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:54 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:54.750807 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:54.752114 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:54.762461 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:54.763207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:54.763818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:54.764539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:54.764996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:54.765426 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:54.903501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:54.913859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:54.915380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:54.916774 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8f0503d5-b3a2-4b9d-ada4-fb725a1c9aa8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.169985 Sep 13 13:10:54.917762 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 386/760] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:54 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:55.353221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "name": "network-vif-plugged", "status": "completed", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:10:55.363217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:55.363991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:55.364617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:55.380544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] Creating event network-vif-plugged:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:10:55.387289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-09cd7c78-3656-4961-a0b8-03ad9e46d7cf req-ef1df94f-c6d3-4f46-8469-8c7db36890a0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036642 Sep 13 13:10:55.388409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 375/761] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:10:55.598115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:55.599058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:55.606113 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:55.606870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:55.607344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:55.608106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:55.608621 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:55.609102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:55.764135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:55.773104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-85e362ec-780b-43a4-800b-e09fd71d5b29 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.178814 Sep 13 13:10:55.773671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 387/762] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:55 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:55.943398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:55.944957 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:55.952003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:55.952687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:55.953198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:55.954102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:55.955007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:55.955711 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:56.100436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:56.109731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:56.111239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:56.112395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6e72f0f7-0738-46db-9d80-d08c7318c42e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.173696 Sep 13 13:10:56.112936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 376/763] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:55 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:56.798245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:56.798856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:56.801787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:56.807675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:56.808369 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:56.809004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:56.809881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:56.810338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:56.810946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:56.966787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:56.975623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7af9e194-a472-49d9-99cd-0c63042f0602 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.181155 Sep 13 13:10:56.976518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 388/764] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:56 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:57.138132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:57.138740 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:57.145833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:57.146610 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:57.147053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:57.147774 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:57.148227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:57.148660 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:57.288232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:57.297642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:57.299104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:57.300285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5ae5f12-997c-4310-ac28-001f78a3390c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.166755 Sep 13 13:10:57.300837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 377/765] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:57 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:58.001017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:58.001974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:58.010009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:58.011102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:58.011698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:58.012666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:58.013116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:58.013542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:58.154867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:58.168731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3d2546f6-dbef-45b0-8db4-d4e854c71ca8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.171070 Sep 13 13:10:58.182916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 389/766] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:57 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:58.328483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:58.329264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:58.331734 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:58.337130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:58.337793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:58.338241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:58.339121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:58.339800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:58.340392 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:58.492516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:58.504258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:58.505908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:58.507149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-020f430c-7fab-477b-bf49-f1b82091c833 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.182651 Sep 13 13:10:58.507793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 378/767] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:58 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:10:59.197597 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:59.199003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:59.205592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:59.206187 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:59.206695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:59.207627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:59.208154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:59.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:59.211605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:10:59.357276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:59.371758 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ec6b9b88-9f39-4edb-a6d2-1b8c5db5c7dc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.179980 Sep 13 13:10:59.372744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 390/768] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:10:59 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:10:59.532700 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:10:59.533477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:10:59.542470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:59.543241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:59.543680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:59.544411 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:10:59.544864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:10:59.545292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:10:59.699988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:59.711408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:59.712566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:10:59.713804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f459a91-2a4b-4c57-850a-b04f13d8329e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.185143 Sep 13 13:10:59.726002 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 379/769] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:10:59 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:00.059248 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:00.059738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:00.066642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.069292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.069292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.069292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.069292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.069705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.098198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3990e344-f35f-4ab8-9eb8-a8255ebffb62 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/ips" status: 200 len: 146 microversion: 2.1 time: 0.042968 Sep 13 13:11:00.120071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 391/770] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:11:00 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/ips => generated 146 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:00.396935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:00.397996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:00.404889 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.411828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.412728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.413765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.414471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.415152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.600319 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:00.610154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7dfc3db-d535-4f25-b8a0-02f8f66af157 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.217440 Sep 13 13:11:00.610738 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 380/771] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:00 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:00.939780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:00.939780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:00.939780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.939780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.941291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.941291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:00.941291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:00.941291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:00.941660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:00.941660 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:00.941927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:00.941927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0be56d38-2342-49ea-83c2-77dad9395eee tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.156257 Sep 13 13:11:00.941927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 392/772] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:00 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:01.638552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:01.640249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:01.647346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:01.648324 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:01.648967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:01.649854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:01.654101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:01.654736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:01.815042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:01.823482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-773be14a-5a2f-4def-9100-b94e6e74f80b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.192840 Sep 13 13:11:01.824018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 381/773] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:01 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:01.970920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:01.971549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:01.978162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:01.978662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:01.979735 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:01.980592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:01.981048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:01.981652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:02.125108 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:02.133826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:02.135835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:02.137074 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42a3b27b-d197-4bab-a84e-30d7109d3770 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.176055 Sep 13 13:11:02.153761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 393/774] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:01 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:02.846908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:02.848190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:02.855741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:02.856603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:02.857087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:02.857858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:02.858381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:02.858808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:03.009012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:03.017921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a948df95-eb1f-424b-a02a-d43938db9d19 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.174733 Sep 13 13:11:03.020080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 382/775] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:02 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:03.164802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:03.165450 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:03.172004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:03.172256 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:03.172798 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:03.173371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:03.174041 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:03.174279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:03.321462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:03.336264 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:03.338041 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:03.340881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e4ed03cf-1e03-4d6b-94b1-95fdea735f48 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.180269 Sep 13 13:11:03.360541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 394/776] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:03 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:04.049614 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:04.050346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:04.056584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.057098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.057547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.058278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.058743 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.059168 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.074519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:04.222306 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:04.230716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-07a75e75-ce2d-4020-bcca-11a804c138a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.186991 Sep 13 13:11:04.231317 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 383/777] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:04 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:04.368548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:04.369165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:04.377163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.377665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.378149 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.378872 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.379395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.379831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.461279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de12b8f2-79cc-408c-b74f-daa2215254ef"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:04.464764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:04.471372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.471866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.472299 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.473166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:04.473629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:04.474082 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:04.552548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:04.563272 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:04.566653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:04.568234 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9d242107-1167-44ab-8396-d5b85ae21f6e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.204284 Sep 13 13:11:04.582297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 395/778] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:04 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:05.255966 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:05.256588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:05.263828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:05.269390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:05.269390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:05.269390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:05.269390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:05.270018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:05.435583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:05.447175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d276d270-f11e-497b-9723-788bbe73e662 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.195407 Sep 13 13:11:05.447973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 396/779] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:05 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:05.595691 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:05.596254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:05.604504 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:05.605155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:05.605599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:05.606320 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:05.606826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:05.607620 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:05.753892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:05.762523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:05.763956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:05.765109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-565372ac-2598-4ca7-9536-efadb1c4e0e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1739 microversion: 2.20 time: 0.173949 Sep 13 13:11:05.765655 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 397/780] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:05 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:05.910918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dcd2152b-0ae1-43a4-bbf1-ba21df248897 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.453694 Sep 13 13:11:05.911530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 384/781] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:11:04 2022] POST /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 194 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:06.472053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:06.473328 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:06.480503 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:06.480991 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:06.481469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:06.482254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:06.482704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:06.483127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:06.794191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:06.795069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:06.802099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:06.802634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:06.803074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:06.803775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:06.804396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:06.804991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:07.006969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:07.018161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0c82cbd-86de-40ec-a2f1-f1e5592499bc tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.549917 Sep 13 13:11:07.019016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 398/782] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:06 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:07.107315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:07.115647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:07.117076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:07.118505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c00e0377-43e7-4a07-80a9-c9bc62a2b4f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1721 microversion: 2.20 time: 0.329877 Sep 13 13:11:07.119065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 385/783] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:06 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:08.047377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:08.048048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:08.054514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.055003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.055446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.056137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.056594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.057659 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.147871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:08.148457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:08.155303 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.155859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.156296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.157209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.157859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.158274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.190677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:08.199096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ba5ca17f-0678-405d-b308-3073ba564b3a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1508 microversion: 2.1 time: 0.155622 Sep 13 13:11:08.201779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 399/784] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:08 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:08.222235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:08.222836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:08.229457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.230504 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.230638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.231317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.231777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.232205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.262037 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121103) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 13:11:08.292256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:08.300691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:08.302085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:08.303242 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b204a7e0-208b-4567-819b-fe295f2ef5a5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1721 microversion: 2.20 time: 0.159199 Sep 13 13:11:08.303836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 386/785] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:08 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:08.566181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e5b3a3a0-e762-4490-a668-2799b6af4421 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "POST /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187/action" status: 202 len: 0 microversion: 2.1 time: 0.347814 Sep 13 13:11:08.567425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 400/786] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:11:08 2022] POST /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:11:08.575900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:08.576741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:08.583143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.583630 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.584066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.584807 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:08.585264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:08.585848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:08.723131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:08.736413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4e81f7e0-c7b2-4111-957e-e7139feb7cc3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1516 microversion: 2.1 time: 0.165339 Sep 13 13:11:08.737233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 387/787] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:08 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:09.328803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:09.329396 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:09.336046 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:09.340358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:09.340358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:09.340358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:09.340358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:09.340757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:09.414949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "name": "network-vif-unplugged", "status": "completed", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:09.426042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:09.426520 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:09.427206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:09.446762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.compute.server_external_events [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] Unable to find a host for instance d54284e3-c8b5-4ca1-8fba-355677093187. Dropping event network-vif-unplugged {{(pid=121102) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 13:11:09.448185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-2ef62efc-7361-4913-b649-0a78026ade3c req-14461796-f6b3-4a12-b194-6da06b7cd9ae service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037901 Sep 13 13:11:09.448933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 388/788] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 13:11:09.485312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:09.494435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:09.495908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:09.497445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-897f4b50-1b7c-4348-a914-ff5c3e5e0ba1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1721 microversion: 2.20 time: 0.172467 Sep 13 13:11:09.497706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 401/789] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:09 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:09.764365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:09.764872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:09.771271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:09.772434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:09.772434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:09.772926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:09.773379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:09.773826 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:09.905919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:09.914046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed4598b5-7362-4720-8011-0658f1176f26 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1516 microversion: 2.1 time: 0.154258 Sep 13 13:11:09.914612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 389/790] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:09 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:10.522956 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:10.523576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:10.530271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.530759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.531201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:10.531894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.532349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.532778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:10.663185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:10.671795 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:10.673224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:10.674408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0b21cb24-f3ee-4771-9b80-b3b2f0c5186c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1724 microversion: 2.20 time: 0.155423 Sep 13 13:11:10.674966 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 402/791] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:10 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:10.698728 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7224abaa-c8f7-4b04-9bfa-659fd0029157"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:10.701221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:10.707717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.708196 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.708633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:10.709316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.709800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.710244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:10.937600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:10.938231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:10.944224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.944715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.945155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:10.945871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:10.946330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:10.946759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:11.078846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:11.086526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-57312465-1fa8-4e1f-af20-2e67c5ecf78d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1516 microversion: 2.1 time: 0.152824 Sep 13 13:11:11.087090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 403/792] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:10 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:11.469928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "name": "network-vif-unplugged", "status": "completed", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:11.479208 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:11.482526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:11.482526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:11.491125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] Creating event network-vif-unplugged:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:11:11.496603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b7c092c5-a089-41aa-9902-325010235083 req-0491c3da-cc0b-46e0-9f9e-8557e885a9cb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030429 Sep 13 13:11:11.497164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 404/793] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:11.602920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce4bec44-e69b-4e21-893a-26511e0c9df9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.908098 Sep 13 13:11:11.603515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 390/794] 10.222.0.72 () {62 vars in 1364 bytes} [Tue Sep 13 13:11:10 2022] POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments => generated 188 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 13:11:11.728693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:11.729280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:11.735875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:11.736365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:11.736810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:11.737501 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:11.737983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:11.738413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:11.935042 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:12.111202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:12.111822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:12.118458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:12.118947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:12.119388 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:12.120079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:12.121271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:12.121706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:12.259167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:12.266857 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a33fddaa-c390-41b0-b7f0-67bd6fb76d76 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1516 microversion: 2.1 time: 0.159518 Sep 13 13:11:12.274243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 391/795] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:12 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:12.528998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c99512ec-b19d-4649-8829-90e16dc2418e tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments/7224abaa-c8f7-4b04-9bfa-659fd0029157" status: 202 len: 0 microversion: 2.20 time: 0.805027 Sep 13 13:11:12.529593 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 405/796] 10.222.0.72 () {60 vars in 1457 bytes} [Tue Sep 13 13:11:11 2022] DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments/7224abaa-c8f7-4b04-9bfa-659fd0029157 => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:11:12.591535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:12.592128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:12.598062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:12.600212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:12.600212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:12.600212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:12.600212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:12.600624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:12.643263 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121102) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 13:11:13.107471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ce3968c7-2cb4-4e17-9a55-df534c207757 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/action" status: 202 len: 0 microversion: 2.20 time: 0.520366 Sep 13 13:11:13.108151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 392/797] 10.222.0.72 () {62 vars in 1319 bytes} [Tue Sep 13 13:11:12 2022] POST /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:11:13.116239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:13.116878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:13.125230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.129683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.129683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:13.129683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.129683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.130123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:13.270881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:13.280052 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:13.281541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:13.282935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-37d5c3ef-2196-4cd3-a0cd-8e2b13fda46c tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1672 microversion: 2.20 time: 0.170567 Sep 13 13:11:13.283497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 406/798] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:13 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:13.291568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:13.294467 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:13.301452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.301631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.302255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:13.303464 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.304054 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.304642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:13.471689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:13.485301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7e7ab69-691d-47bd-8018-4f42f72ab1e3 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1518 microversion: 2.1 time: 0.196152 Sep 13 13:11:13.494739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 393/799] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:13 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:13.975550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:13.980282 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:13.986026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.986511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.986947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:13.987639 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:13.988090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:13.988510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.022638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5a70ece6-a791-4225-a698-a44bf5aa21ac tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051008 Sep 13 13:11:14.023268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 407/800] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:13 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:14.034738 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:14.038671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:14.041706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.042784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.043371 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.044035 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.044485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.044903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.082131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7dd94989-9768-452a-b6cf-54021132f56e tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef" status: 200 len: 194 microversion: 2.1 time: 0.051885 Sep 13 13:11:14.083102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 394/801] 10.222.0.72 () {58 vars in 1413 bytes} [Tue Sep 13 13:11:14 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:14.312748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:14.313371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:14.320297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.320722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.321194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.321930 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.322419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.322847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.467627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:14.475723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:14.477352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:14.478530 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-805fb06b-4cc4-40c7-9629-3e37868dbea6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1672 microversion: 2.20 time: 0.171491 Sep 13 13:11:14.479118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 408/802] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:14 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:14.509535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:14.510175 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:14.517144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.517630 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.518103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.518889 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:14.519342 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:14.519760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:14.666333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:14.666333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:14.671798 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1541c184-249a-4076-973b-9855513d204f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1518 microversion: 2.1 time: 0.166092 Sep 13 13:11:14.672371 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 395/803] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:14 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:15.505031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:15.505679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:15.512655 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.513145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.525911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.525911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.525911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.525911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.698213 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:15.698213 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:15.703927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.704374 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.705517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.706690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.707378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.707958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.730604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:15.739141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:15.740524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:15.748857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-876da7ae-444d-4fc8-8e62-9a7522053642 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.240553 Sep 13 13:11:15.748857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 409/804] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:15 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:15.748857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0433ed42-90f9-441e-b877-b8f85be1ad0d"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:15.749890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:15.755831 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.756322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.756756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.757465 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:15.757934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:15.758391 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:15.851915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:15.859885 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e9dfc670-6f5f-477d-b747-a1662232b7fe tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.167768 Sep 13 13:11:15.860449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 396/805] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:15 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:16.649478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d7d981b-5c36-4876-8f0b-8abd655fb12d tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "POST /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905874 Sep 13 13:11:16.650253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 410/806] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:11:15 2022] POST /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:16.769488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:16.770127 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:16.777766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:16.778283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:16.778727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:16.779436 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:16.779969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:16.780377 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:16.884844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:16.885674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:16.893040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:16.893910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:16.894528 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:16.895219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:16.895754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:16.896336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:16.930616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:16.939572 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:16.941265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:16.942476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9dceb8f-a689-46cd-81d0-cd7e7685f054 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.177266 Sep 13 13:11:16.950730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 397/807] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:16 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:17.037045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:17.045349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4158799-f6e8-43f1-bddd-39619918efb7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.165143 Sep 13 13:11:17.045932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 411/808] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:16 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:17.968611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:17.969226 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:17.975504 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:17.975992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:17.976427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:17.977155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:17.977606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:17.978052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:18.069582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:18.069582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:18.079516 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:18.080027 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:18.080472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:18.081192 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:18.081657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:18.082119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:18.259692 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:18.272068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:18.277130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:18.279235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0bbe7b9f-dafc-4d68-baa1-81a775cd875b tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.314648 Sep 13 13:11:18.280100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 398/809] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:17 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:18.304693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:18.318374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4885c340-c6f7-4959-a4d0-debfe2cb95de tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.253663 Sep 13 13:11:18.319266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 412/810] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:18 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:19.306990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:19.308301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:19.315547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:19.316714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:19.317344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:19.318297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:19.318917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:19.319506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:19.348624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:19.349179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:19.365995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:19.366821 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:19.368300 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:19.369224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:19.371240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:19.376068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:19.580482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:19.588647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:19.591142 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:19.592502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-11d4f2c2-9ecc-42d5-bf9d-8cac3f97d6f1 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.290588 Sep 13 13:11:19.593243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 399/811] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:19 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:19.607627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:19.616143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-65dd42d4-0d5f-4068-9262-e3862994d0cf tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.271297 Sep 13 13:11:19.630505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 413/812] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:19 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:20.621213 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:20.621928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:20.636985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:20.638026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:20.638655 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:20.639789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:20.640292 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:20.640897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:20.641007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:20.641568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:20.648628 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:20.650437 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:20.650990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:20.652998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:20.653591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:20.654223 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:20.892973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:20.905420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:20.907198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:20.909364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2c5cea4-a32d-4853-b3ec-451aa9a86971 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.292763 Sep 13 13:11:20.910214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 400/813] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:20 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:20.920971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:20.929004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-36899635-ef11-4e9f-babc-a3320942d71e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.292431 Sep 13 13:11:20.931085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 414/814] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:20 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:21.937609 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:21.939200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:21.946429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:21.947046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:21.947580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:21.948601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:21.949330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:21.949996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:21.953718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:21.954355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:21.961030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:21.961973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:21.962598 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:21.963536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:21.964738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:21.965480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:22.170713 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:22.179893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2cc7ace5-6a82-48c2-a38d-7e6bc11a7645 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.230512 Sep 13 13:11:22.185945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 415/815] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:21 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:22.198806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:22.207534 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:22.209052 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:22.210389 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3096676d-bb7f-46a3-8338-00cbd87cf361 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.277568 Sep 13 13:11:22.211164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 401/816] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:21 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:23.204092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:23.204786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:23.211112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:23.211609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:23.212049 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:23.212758 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:23.213213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:23.213641 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:23.237289 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:23.238606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:23.253506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:23.257704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:23.257704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:23.257704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:23.257704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:23.258123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:23.445333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:23.457587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dd8c8d70-ffce-46cd-b5dc-8fccbcac3336 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.257214 Sep 13 13:11:23.475026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 416/817] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:23 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:23.504006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:23.518502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:23.519960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:23.521174 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-381f5413-0c6b-4fd3-8981-4781e72a5210 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.288513 Sep 13 13:11:23.521732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 402/818] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:23 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:24.483439 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:24.484052 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:24.490662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:24.491138 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:24.491775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:24.492488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:24.492944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:24.493371 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:24.549099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:24.549960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:24.569864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:24.570455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:24.571139 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:24.572058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:24.572709 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:24.573464 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:24.724090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:24.734679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b4298173-6df0-41f0-ad11-7cb1c629ae24 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.255689 Sep 13 13:11:24.735205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 417/819] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:24 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:24.764650 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:24.773858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:24.775333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:24.777340 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e6c94a9-9ed5-4833-8c28-f764c8098364 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.231362 Sep 13 13:11:24.777916 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 403/820] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:24 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:25.760168 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:25.760901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:25.767607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:25.768019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:25.768455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:25.769159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:25.769678 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:25.770129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:25.805447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:25.806624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:25.813068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:25.813559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:25.814032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:25.814736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:25.815189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:25.815642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:26.012324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:26.021176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5dcbc493-ca39-42d0-a628-585c616efa44 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.264936 Sep 13 13:11:26.021647 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 418/821] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:25 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:26.030574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:26.039224 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:26.043982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:26.043982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3db879ce-74a0-49af-b338-8f977787d32a tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.242480 Sep 13 13:11:26.043982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 404/822] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:25 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:27.046722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:27.047338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:27.051532 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:27.054927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:27.055416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:27.055860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:27.056562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:27.057018 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:27.058147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:27.068586 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:27.072873 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:27.076372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:27.077079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:27.077516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:27.078239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:27.078852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:27.079463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:27.079881 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:27.258705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:27.266646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-af3dd54d-e9c2-4d0c-a3ab-7259dee0f8a5 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.223893 Sep 13 13:11:27.273667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 419/823] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:27 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:27.273984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:27.278129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:27.279563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:27.280713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f6c3bd6a-a2f2-45e0-92b5-ae6ac0118335 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.216140 Sep 13 13:11:27.281256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 405/824] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:27 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:28.293795 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:28.294425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:28.302407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:28.302902 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:28.303500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:28.304205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:28.304666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:28.305100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:28.306745 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:28.309247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:28.314619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:28.315137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:28.315571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:28.316270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:28.316715 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:28.317133 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:28.502514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:28.514596 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:28.514927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7240af2f-93e1-4095-b664-87e0c3924eb2 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.227491 Sep 13 13:11:28.516169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 420/825] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:28 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:28.524491 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:28.526988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:28.531068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-38e22f8f-6c3d-479a-9020-757dd557a8f8 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.225536 Sep 13 13:11:28.531068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 406/826] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:28 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:29.216815 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:29.217317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:29.223281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.223775 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.224216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.224912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.225370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.225836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.248415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df54cee4-adea-4bd1-a6dd-1d520a96ca54 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/ips" status: 200 len: 150 microversion: 2.1 time: 0.036049 Sep 13 13:11:29.248998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 421/827] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:11:29 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:29.540325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:29.540936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:29.547354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:29.564047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.565493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.566132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.567060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.567742 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.568285 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.572233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:29.572868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:29.581455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.582017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.587549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.587549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:29.587549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:29.587549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:29.780004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:29.782869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:29.788852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1eec0118-2b32-4f29-8ebb-823e12d0dc41 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.252484 Sep 13 13:11:29.791375 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:29.794446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:29.795198 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-632d4b6b-2ed3-4f31-bcea-0ab75bebf2b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.231345 Sep 13 13:11:29.806730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 407/828] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:29 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:29.814614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 422/829] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:29 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:30.813517 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:30.814178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:30.821217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:30.821419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:30.821902 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:30.822024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:30.822456 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:30.823148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:30.823649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:30.824279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:30.828850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:30.829607 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:30.830081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:30.830973 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:30.831431 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:30.831860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:31.035425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:31.038389 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:31.045544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ed9aaccf-8c24-45c3-b6c4-40625d5d49a8 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.234159 Sep 13 13:11:31.046170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 408/830] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:30 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:31.047548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:31.049103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:31.050315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-16c6da6d-edfd-46f3-8820-5b5d84ad4701 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.232818 Sep 13 13:11:31.051005 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 423/831] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:30 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:11:31.051134 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbbfc69b-ca86-4a77-9d44-7130803d5e43"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:31.053531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:31.059923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:31.060405 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:31.060833 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:31.061597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:31.062100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:31.062519 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:31.607739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "name": "network-vif-plugged", "status": "completed", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:31.617152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:31.617623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:31.618080 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:31.629165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] Creating event network-vif-plugged:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:11:31.638162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-11ba5e72-9efa-471a-b246-6c6f6dd7610f req-981b9f23-588d-41d8-867c-4ce5c42ea72e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 Sep 13 13:11:31.638624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 424/832] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:32.070890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:32.072322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:32.078758 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:32.079243 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:32.079859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:32.080552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:32.081169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:32.081977 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:32.242968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:32.254883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db0ad200-da2f-4fcc-80e1-b5cbb87362af tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.188994 Sep 13 13:11:32.255454 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 425/833] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:32 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:32.260015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:32.260622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:32.266669 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:32.267256 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:32.267958 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:32.268596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:32.272303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:32.272303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:32.460965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:32.469186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:32.470670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:32.471828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fef6d0dd-16a5-4110-99b3-3e3febc146e6 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.215456 Sep 13 13:11:32.472392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 426/834] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:32 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:32.584032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-acea6a88-1d10-4ca8-a6a9-3721085e984b tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "POST /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.536622 Sep 13 13:11:32.584760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 409/835] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:11:31 2022] POST /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments => generated 194 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:33.279441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:33.280067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:33.287010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:33.287531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:33.287972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:33.288715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:33.289174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:33.289611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:33.456252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:33.464585 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-035e3d50-c9e1-4577-8419-83fb809b8b14 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1574 microversion: 2.1 time: 0.189526 Sep 13 13:11:33.466119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 427/836] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:33 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:33.498102 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:33.498987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:33.505868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:33.506488 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:33.507027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:33.507853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:33.508413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:33.508940 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:33.644428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:33.656971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "name": "network-vif-plugged", "status": "completed", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:33.684683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:33.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:33.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:33.684875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:33.685173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:33.686045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-878a1dd3-75a7-41ff-a189-15b86514faa5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.192998 Sep 13 13:11:33.686918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 410/837] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:33 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:33.695694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] Creating event network-vif-plugged:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:11:33.701147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9ef720e8-8e63-460d-aa7e-bf1d43411d10 req-5205d835-ae87-4565-941a-eb9b09719356 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048889 Sep 13 13:11:33.701965 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 428/838] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:34.488511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:34.489402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:34.495734 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.499837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.499837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:34.499837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.499837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.500219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:34.501284 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:34.706505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:34.723347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:34.724332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:34.730159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d584c76-ad00-42d3-abf1-6b4cd1536d0b tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1561 microversion: 2.1 time: 0.245473 Sep 13 13:11:34.730830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 411/839] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:34 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:34.736335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.736711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.737344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:34.738251 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.738932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.739294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:34.896577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:34.905149 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:34.906594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:34.907778 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f4b23b54-177f-4897-b582-979bc0a8a4f9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.189252 Sep 13 13:11:34.908417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 429/840] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:34 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:34.959688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:34.961992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:34.968442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.969115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.969708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:34.970595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:34.971395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:34.971982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.004657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-20735429-bb2b-463a-a3a8-56aea3a53d2b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049028 Sep 13 13:11:35.005143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 412/841] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:34 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:35.145284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:35.145846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:35.151797 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.152287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.153224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.153949 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.154413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.154841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.186298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b6d80dbe-6d42-4ddc-934b-7611a049f591 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef" status: 200 len: 194 microversion: 2.1 time: 0.044903 Sep 13 13:11:35.186882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 430/842] 10.222.0.72 () {58 vars in 1413 bytes} [Tue Sep 13 13:11:35 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:35.197310 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:35.197932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:35.203952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.204435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.204871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.208737 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.208737 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.208737 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.349865 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lazy-loading 'services' on Instance uuid 9ec3a98d-7f9d-4145-b596-02b4b7868127 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:11:35.641509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-adf36288-4058-40e3-be1a-e49a7af259b3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef" status: 202 len: 0 microversion: 2.1 time: 0.447940 Sep 13 13:11:35.643005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 413/843] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:11:35 2022] DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/de12b8f2-79cc-408c-b74f-daa2215254ef => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:11:35.936006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:35.937993 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:35.944860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.944974 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.945377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:35.946115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:35.946690 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:35.947107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:36.085551 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:36.093904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:36.095344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:36.096507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9440af68-417c-4895-9617-469ff747f3f5 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.165954 Sep 13 13:11:36.097060 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 431/844] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:35 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:37.124202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:37.124896 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:37.131145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:37.131683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:37.132122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:37.132820 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:37.133282 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:37.133686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:37.269081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:37.278644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:37.279128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:37.280391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5bcae82f-4ce7-42f7-b0ef-4c1c90ad9b93 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1730 microversion: 2.20 time: 0.161209 Sep 13 13:11:37.281271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 414/845] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:37 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:38.206822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:38.207335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:38.213689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.214239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.214673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.215358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.215810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.216834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.298152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'services' on Instance uuid f1d00a32-cda7-4b1d-8f9f-1c0856011372 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:11:38.307045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:38.307662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:38.314115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.314748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.315187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.315884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.316336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.316759 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.522434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-72311348-b1fb-417c-92e4-799da4ca5df5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments/cbbfc69b-ca86-4a77-9d44-7130803d5e43" status: 202 len: 0 microversion: 2.1 time: 0.319342 Sep 13 13:11:38.523247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 432/846] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:11:38 2022] DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments/cbbfc69b-ca86-4a77-9d44-7130803d5e43 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:11:38.533318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:38.536381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:38.545592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.546374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.546992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.547869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.548482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.549102 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.586773 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-68888041-a701-4e00-99f2-b8b6071f96b0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058674 Sep 13 13:11:38.587837 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 433/847] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:38 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:38.720458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:38.729878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:38.731330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:38.733315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2a9c1db2-fdba-49ad-bcb3-71c18058c412 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1717 microversion: 2.20 time: 0.431233 Sep 13 13:11:38.735147 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 415/848] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:11:38 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1717 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:11:38.892605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:38.893101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:38.899115 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.899627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.900071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.900765 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.901219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.901644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.931363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3e43dc4-4b3a-48fa-a004-8899f1c8b09c tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/0433ed42-90f9-441e-b877-b8f85be1ad0d" status: 200 len: 194 microversion: 2.1 time: 0.043066 Sep 13 13:11:38.931938 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 434/849] 10.222.0.72 () {58 vars in 1413 bytes} [Tue Sep 13 13:11:38 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/0433ed42-90f9-441e-b877-b8f85be1ad0d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:38.942747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:38.943232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:38.949027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.949501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.949965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:38.950773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:38.951220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:38.951654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:39.032937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lazy-loading 'services' on Instance uuid 9ec3a98d-7f9d-4145-b596-02b4b7868127 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:11:39.297151 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a7e6d078-d51b-4187-acb0-191ad6f70e85 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/0433ed42-90f9-441e-b877-b8f85be1ad0d" status: 202 len: 0 microversion: 2.1 time: 0.358142 Sep 13 13:11:39.297799 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 416/850] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:11:38 2022] DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments/0433ed42-90f9-441e-b877-b8f85be1ad0d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:11:39.600024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:39.610342 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:39.615276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:39.615731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:39.616146 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:39.616886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:39.617434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:39.617794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:39.649048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-52da67be-19df-4ea4-9e65-a565e7b41163 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052875 Sep 13 13:11:39.649610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 435/851] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:39 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:40.478511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:40.481129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:40.488512 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.489008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.489423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.490479 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.490926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.491556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.521003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d1f012a-2285-4bd6-87f1-e98e76ec7195 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046862 Sep 13 13:11:40.521565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 417/852] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:40 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 13:11:40.653498 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:40.653498 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:40.660276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.660766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.661244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.661940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.662398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.662856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.672493 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:40.680043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:40.690323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.690818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.691245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.692158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.692604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.693209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.697446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ceed0481-d22f-4549-a6c3-ab315d1c99dd tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051501 Sep 13 13:11:40.698254 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 436/853] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:40 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:11:40.724578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-85b33f65-ae81-4590-9129-a972ff87c5b9 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061653 Sep 13 13:11:40.725146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 418/854] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:11:40 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:11:40.775331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:40.775846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:40.782906 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.783398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.783964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.784826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.785409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.785947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.791827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:40.792800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:40.793341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:40.800478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.801093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.802090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.802958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:40.803194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:40.803848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:40.814350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:11:40.832492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:11:41.269427 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a8d55e74-e8c6-486c-b382-f6431e0aa626 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 204 len: 0 microversion: 2.1 time: 0.497719 Sep 13 13:11:41.270428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 437/855] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:40 2022] DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:11:41.278971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:41.279675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:41.287281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:41.287774 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:41.288216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:41.288914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:41.289374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:41.289832 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:41.368308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ddb61943-e3b3-4d61-aa97-d0925a07c3e5 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 204 len: 0 microversion: 2.1 time: 0.579049 Sep 13 13:11:41.369884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 419/856] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:40 2022] DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 13:11:41.379094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:41.380092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:41.386953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:41.387441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:41.387915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:41.388562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:41.389006 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:41.389424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:41.423445 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:41.432612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-586178d2-43c6-4466-a600-43b328469a6b tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1675 microversion: 2.1 time: 0.157707 Sep 13 13:11:41.433183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 438/857] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:41 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:41.555708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:41.563447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-47c839ec-4b3e-4a1e-9699-48439507da21 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1682 microversion: 2.1 time: 0.190109 Sep 13 13:11:41.564381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 420/858] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:41 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:42.455416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:42.456033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:42.462456 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:42.462945 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:42.463385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:42.464083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:42.464540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:42.464968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:42.588047 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:42.589278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:42.596387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:42.596977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:42.597706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:42.598176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:42.598876 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:42.599331 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:42.600351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:42.605317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efdad432-4f86-4493-9609-17826a0ceccc tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1675 microversion: 2.1 time: 0.153598 Sep 13 13:11:42.605948 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 439/859] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:42 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:42.733521 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:42.741993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-15d6a8ea-63db-46ea-9edb-0366b787e109 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1682 microversion: 2.1 time: 0.157700 Sep 13 13:11:42.742613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 421/860] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:42 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:43.630619 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:43.631845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:43.638714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:43.639207 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:43.639643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:43.640382 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:43.641235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:43.641468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:43.765396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:43.766469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:43.773061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:43.773632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:43.774174 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:43.774973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:43.775498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:43.775989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:43.841761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:43.849980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3947b6d0-e9c9-4ea1-8596-014a6e001992 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1675 microversion: 2.1 time: 0.223109 Sep 13 13:11:43.850548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 440/861] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:43 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:43.949270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:43.957158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fd32715b-495d-4e59-bc2a-afa003507cbd tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1682 microversion: 2.1 time: 0.195610 Sep 13 13:11:43.957713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 422/862] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:43 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:44.874657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:44.875801 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:44.882370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:44.882880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:44.883315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:44.884020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:44.884481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:44.884933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:44.981793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:44.983007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:44.989853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:44.990340 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:44.990769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:44.991462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:44.991913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:44.992330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:45.364089 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:45.373177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1dc43cc3-71ad-4811-99d2-c35ba2063507 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1675 microversion: 2.1 time: 0.502491 Sep 13 13:11:45.374459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 441/863] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:44 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1675 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:45.407178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:45.415864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-429d62c1-3240-407c-990c-b7f5723557d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1682 microversion: 2.1 time: 0.437963 Sep 13 13:11:45.416770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 423/864] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:44 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1682 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:46.243336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec3a98d-7f9d-4145-b596-02b4b7868127", "name": "network-vif-deleted", "tag": "9c44e815-baec-4fbf-899a-28661f1fa44a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:46.260492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:46.260996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:46.264802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:46.288936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] Creating event network-vif-deleted:9c44e815-baec-4fbf-899a-28661f1fa44a for instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 on hv-cinder-80135 Sep 13 13:11:46.305709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-142ca2c5-9bad-4972-b399-6de955060d83 req-f355a988-e808-4642-b4b1-571b3b627f64 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065917 Sep 13 13:11:46.309422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 442/865] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:46.397487 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:46.399015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:46.407301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:46.408014 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:46.409235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:46.410169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:46.410907 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:46.411565 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:46.442632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:46.443981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:46.458643 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:46.459728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:46.460185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:46.461357 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:46.462465 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:46.462996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:46.528187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:46.536348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:46.539985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-afb72de1-37ad-46ef-acd6-a20e5ef828d7 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1607 microversion: 2.1 time: 0.146779 Sep 13 13:11:46.551007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 424/866] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:46 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1607 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:46.577302 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:46.585630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-02ad6b58-c6c5-42da-9f21-27055cb8e573 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1615 microversion: 2.1 time: 0.149763 Sep 13 13:11:46.586240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 443/867] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:46 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1615 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:47.572395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:47.573032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:47.581171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.581978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.582583 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.583293 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.583752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.584182 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.610146 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:47.610764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:47.617299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.617860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.621733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.621733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.621733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.621733 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.629543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.630095 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.630537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.631025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lazy-loading 'fault' on Instance uuid 9ec3a98d-7f9d-4145-b596-02b4b7868127 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:11:47.670460 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:47.670947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:47.671386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:47.672706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lazy-loading 'fault' on Instance uuid f1d00a32-cda7-4b1d-8f9f-1c0856011372 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:11:47.677165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b1c15ff53e5442881b56bf504b9a31b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f6274158934ab5abf68951902f1e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:47.684693 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b26d4cea-1ff5-404f-a9ac-dee08c5fc552 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 200 len: 1328 microversion: 2.1 time: 0.118908 Sep 13 13:11:47.685330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 425/868] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:47 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:47.714493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fadb80f21614816b3526d59b2d8a0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7775bd9f19b64c8ca07407c103dcff9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:47.722239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-324724ce-998b-41d8-968c-b942a14280d2 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 200 len: 1332 microversion: 2.1 time: 0.115982 Sep 13 13:11:47.722799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 444/869] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:47 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:48.320550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d00a32-cda7-4b1d-8f9f-1c0856011372", "name": "network-vif-deleted", "tag": "54c2670f-bc7d-4b11-9765-a6b741484f6f"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:48.330770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:48.332573 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:48.332573 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:48.343207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] Creating event network-vif-deleted:54c2670f-bc7d-4b11-9765-a6b741484f6f for instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 on hv-cinder-80135 Sep 13 13:11:48.349341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-780d4106-de94-46f4-8bc3-45990d9afc12 req-f813a288-abe4-428c-b38c-05dd1b3944d7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Sep 13 13:11:48.349952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 426/870] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:11:48.708837 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:48.709446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:48.716073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:48.717143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:48.717265 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:48.717960 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:48.719040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:48.719475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:48.735329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 HTTP/1.1 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:48.737017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:48.738570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '9ec3a98d-7f9d-4145-b596-02b4b7868127'} Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:48.739340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:48.740662 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.741864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:48.741864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a72ff5e-74cc-4f88-9726-b35a3010ea19 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 404 len: 111 microversion: 2.1 time: 0.033518 Sep 13 13:11:48.741864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 445/871] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:48 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:48.748083 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a4200d7-85e8-428c-9703-38eb87a91fe3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '.version_select at 0x7f1564fab790>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:48.748627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:48.749086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:48.756177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:48.756873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:48.757698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:48.758085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:48.758591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:48.759032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:48.773358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 HTTP/1.1 Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:48.775811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:48.777731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'f1d00a32-cda7-4b1d-8f9f-1c0856011372'} Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:48.778725 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:48.780638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:48.782812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:48.782812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a93fb970-26df-4c8e-8fbd-1ccc74ada754 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 404 len: 111 microversion: 2.1 time: 0.031587 Sep 13 13:11:48.782812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 446/872] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:48 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:48.786179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3fc5371-d47e-4233-844b-9dc180118efe tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '.version_select at 0x7f1564fcdca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:48.826486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a4200d7-85e8-428c-9703-38eb87a91fe3 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116904173" status: 202 len: 0 microversion: 2.1 time: 0.082500 Sep 13 13:11:48.826987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 427/873] 10.222.0.72 () {58 vars in 1221 bytes} [Tue Sep 13 13:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116904173 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:11:48.898737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3fc5371-d47e-4233-844b-9dc180118efe tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684107212" status: 202 len: 0 microversion: 2.1 time: 0.117341 Sep 13 13:11:48.902754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 447/874] 10.222.0.72 () {58 vars in 1221 bytes} [Tue Sep 13 13:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684107212 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:11:49.174291 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1211911674", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "networks": [{"uuid": "eec74a46-1341-4521-af9d-fbe61d5591cd"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:49.230776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] validate_networks() for [('eec74a46-1341-4521-af9d-fbe61d5591cd', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:11:49.956690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:11:49.957207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:11:49.957599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:11:49.958062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:11:49.958477 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:11:49.967385 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:49.967927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:49.969008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:49.969926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:49.970445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:49.970879 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:49.988646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Getting quotas for project 15bcfc71833149c194401e5afb6e5d18. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:11:49.992806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Getting quotas for user 81634611141f4909a52ac46d5164f17f and project 15bcfc71833149c194401e5afb6e5d18. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:11:50.005111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:11:50.011990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:11:50.136705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10b752a9-d65e-4591-b754-561e18adaa93 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966611 Sep 13 13:11:50.138179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 428/875] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:11:50.149766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2792ee2a-bfb7-4457-8947-b129fba882c4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:50.150381 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2792ee2a-bfb7-4457-8947-b129fba882c4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:50.212283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2792ee2a-bfb7-4457-8947-b129fba882c4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:50.219909 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2792ee2a-bfb7-4457-8947-b129fba882c4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1219 microversion: 2.1 time: 0.074481 Sep 13 13:11:50.220479 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 448/876] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:50 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:51.243038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9ef039c3-f220-4aa0-8c73-8e19f76f25c9 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:51.243646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9ef039c3-f220-4aa0-8c73-8e19f76f25c9 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:51.298043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9ef039c3-f220-4aa0-8c73-8e19f76f25c9 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:51.305660 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9ef039c3-f220-4aa0-8c73-8e19f76f25c9 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1219 microversion: 2.1 time: 0.066546 Sep 13 13:11:51.306230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 429/877] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:51 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:51.454631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:51.455205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:51.462132 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:51.462615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:51.463119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:51.463840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:51.464291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:51.464715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:51.492026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 HTTP/1.1 Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:51.493569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.495224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'f1d00a32-cda7-4b1d-8f9f-1c0856011372'} Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:51.496103 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.497370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.498768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:51.498768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ed5474cf-5eaf-4368-9f2d-ff5600087db0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 404 len: 111 microversion: 2.1 time: 0.044444 Sep 13 13:11:51.498768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 449/878] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:51 2022] DELETE /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:11:51.505253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:51.506258 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: f1d00a32-cda7-4b1d-8f9f-1c0856011372] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:51.512358 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:51.512867 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:51.513300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:51.514195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:51.514645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:51.515119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:51.528262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 HTTP/1.1 Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:51.534463 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.536119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'f1d00a32-cda7-4b1d-8f9f-1c0856011372'} Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:51.537024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. Sep 13 13:11:51.538538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:51.539946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance f1d00a32-cda7-4b1d-8f9f-1c0856011372 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:51.539946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d52cd97d-24f2-4b37-87f2-403c81711215 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372" status: 404 len: 111 microversion: 2.1 time: 0.030147 Sep 13 13:11:51.539946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 430/879] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:51 2022] GET /compute/v2.1/servers/f1d00a32-cda7-4b1d-8f9f-1c0856011372 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:52.330215 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.330928 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.336891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.337395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.341904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.341904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.341904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.341904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.406712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:52.414854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1324a80e-fcfa-4103-8696-84ad08fad142 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1271 microversion: 2.1 time: 0.089115 Sep 13 13:11:52.415420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 450/880] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:52 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:52.758260 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.758785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.765353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.765960 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.766403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.767099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.767553 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.767975 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.783050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 HTTP/1.1 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:52.784891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.786332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '9ec3a98d-7f9d-4145-b596-02b4b7868127'} Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:52.787063 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.788261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.789469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:52.789469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-934263de-ed5a-4484-a7e8-83029f9d396f tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 404 len: 111 microversion: 2.1 time: 0.032088 Sep 13 13:11:52.789469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 431/881] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:52 2022] DELETE /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:52.796172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.797818 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9ec3a98d-7f9d-4145-b596-02b4b7868127] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.804507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.805009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.805451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.806193 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.806653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.807088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.821109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 HTTP/1.1 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:52.822687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.825296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '9ec3a98d-7f9d-4145-b596-02b4b7868127'} Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:52.826203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. Sep 13 13:11:52.828644 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.830088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9ec3a98d-7f9d-4145-b596-02b4b7868127 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:52.830088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dbfcc773-f0f7-4480-a3d6-1b89ba1cc938 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127" status: 404 len: 111 microversion: 2.1 time: 0.031949 Sep 13 13:11:52.830088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 451/882] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:52 2022] GET /compute/v2.1/servers/9ec3a98d-7f9d-4145-b596-02b4b7868127 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:52.886882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.887434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.893976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.894551 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.895173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.896029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.896494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.896926 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.911030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f HTTP/1.1 Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:52.912978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.914502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'e89044a6-3b0a-4879-9409-b492f10c1f3f'} Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:52.915223 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.916395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.918990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:52.919917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3da3f755-5431-4436-a4cd-0341d6644ad7 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 404 len: 111 microversion: 2.1 time: 0.037030 Sep 13 13:11:52.920549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 432/883] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:52 2022] DELETE /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:52.929378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.930010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: e89044a6-3b0a-4879-9409-b492f10c1f3f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.944317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.945026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.945981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.950372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.950372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.950372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.963322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f HTTP/1.1 Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:52.964844 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.966315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'e89044a6-3b0a-4879-9409-b492f10c1f3f'} Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:52.967036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. Sep 13 13:11:52.968269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:52.970944 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance e89044a6-3b0a-4879-9409-b492f10c1f3f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:52.971996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-215f0aed-7ad6-4758-b0b8-3d9bc8c368b8 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f" status: 404 len: 111 microversion: 2.1 time: 0.046582 Sep 13 13:11:52.975767 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 452/884] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:52 2022] GET /compute/v2.1/servers/e89044a6-3b0a-4879-9409-b492f10c1f3f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:52.980835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:52.981292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:52.988283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.988772 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.989207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:52.989938 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:52.990390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:52.990815 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:53.007475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc HTTP/1.1 Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:53.009201 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.010556 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc'} Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:53.011406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.012667 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.013977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:53.013977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b9a8633-3ea5-47c8-8ef1-821d06eeb798 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 404 len: 111 microversion: 2.1 time: 0.033796 Sep 13 13:11:53.013977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 433/885] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:52 2022] DELETE /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:53.020136 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:53.022125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:53.028120 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:53.029074 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:53.029692 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:53.030458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:53.031313 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:53.031748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:53.045904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc HTTP/1.1 Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:53.048110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.049555 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc'} Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:53.050334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. Sep 13 13:11:53.051511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:53.052612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:53.052612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-093b37bf-4917-4277-9540-e48878dcbcfc tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc" status: 404 len: 111 microversion: 2.1 time: 0.034128 Sep 13 13:11:53.052612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 453/886] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:53 2022] GET /compute/v2.1/servers/a1157c37-0bf6-4c6b-b4f7-c22c1e074cdc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:11:53.438751 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:53.439397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:53.445440 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:53.445962 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:53.446428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:53.447132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:53.447606 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:53.448029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:53.644985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:53.655270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-549b0abc-8e52-4033-97ec-0288a3ab8572 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.220394 Sep 13 13:11:53.656567 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 434/887] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:53 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:11:54.112870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:54.113358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:54.119789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.120312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.120748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.121438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.121923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.122345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.136541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 HTTP/1.1 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:54.138322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.139865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '9571f561-e164-4b23-8ffe-8fc0cfcb7321'} Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:54.141475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.143096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.144898 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:54.144898 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a0492b1-1017-4380-9a3d-1541dadede21 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 404 len: 111 microversion: 2.1 time: 0.030746 Sep 13 13:11:54.144898 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 454/888] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:54 2022] DELETE /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:54.148935 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:54.149544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] [instance: 9571f561-e164-4b23-8ffe-8fc0cfcb7321] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:54.156199 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.156688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.157228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.157895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.158348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.161731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.172704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] HTTP exception thrown: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Request method failure captured: Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 HTTP/1.1 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIAPbMiVYwZNKkfdWVfWVMY--Rtbn7SEQQ_zFVNacTh3HfYXAPIkQrN4LHnF7-1PfzH63-zzoDWRhsPYoIp8_nevnZ9yMHqi4SPOC4RLcl1fQeiiT5AhADuPzw929fa0WRI36fQ5hy1lB1uvaR_eM8a8g2721Ky50BnFdudR6dLHLHQ Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:54.174256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/75f6274158934ab5abf68951902f1e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_75f6274158934ab5abf68951902f1e81", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/75f6274158934ab5abf68951902f1e81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 75f6274158934ab5abf68951902f1e81 Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeTestJSON-388680270 Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 7b1c15ff53e5442881b56bf504b9a31b Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeTestJSON-388680270-project Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.175791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '9571f561-e164-4b23-8ffe-8fc0cfcb7321'} Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:54.177087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. Sep 13 13:11:54.179202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.180569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] Returning 404 to user: Instance 9571f561-e164-4b23-8ffe-8fc0cfcb7321 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:54.180569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ac6dfdc9-0395-42bc-b0cb-b9d647d8d937 tempest-AttachVolumeTestJSON-388680270 tempest-AttachVolumeTestJSON-388680270-project] 10.222.0.72 "GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321" status: 404 len: 111 microversion: 2.1 time: 0.030490 Sep 13 13:11:54.180569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 435/889] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:54 2022] GET /compute/v2.1/servers/9571f561-e164-4b23-8ffe-8fc0cfcb7321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:54.400866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:54.401468 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:54.408063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.408826 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.409524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.410258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.410719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.411177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.427083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b HTTP/1.1 Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:11:54.428654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.430135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '42476fd8-5bc5-47f9-8aa9-da3e3012656b'} Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:54.430880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.432322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.433917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:54.433917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-563535e1-3149-489f-83f4-4752c3a8f1d0 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 404 len: 111 microversion: 2.1 time: 0.033070 Sep 13 13:11:54.433917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 455/890] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:11:54 2022] DELETE /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:11:54.449228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:54.450297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] [instance: 42476fd8-5bc5-47f9-8aa9-da3e3012656b] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:54.457891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.458500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.461704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.461704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.461704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.461704 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.464784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecc5a5a-6763-4828-8455-85170317a518", "tag": "e6137dd3-fadf-423f-a6c7-43a80e68f9b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:11:54.476721 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.477233 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.477470 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] HTTP exception thrown: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.477649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Request method failure captured: Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b HTTP/1.1 Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIABu6TFl6dNCEDScCQXF8zioV3XUoWkk6bU5p4W5KiCwEUpNSW3mAD0ozKFMrqWmrGs-q92bhZGwxlNRjvRwJb4fV3sdrLrRo3pd_vtB3c9HoTLiouzzJMJwqrSS4QM3-9bSyDv8xdWcahIa8eW5zHzXJeT0ES7EAHvJTvayw9Sa8s Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:11:54.479205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7775bd9f19b64c8ca07407c103dcff9b", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7775bd9f19b64c8ca07407c103dcff9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 7775bd9f19b64c8ca07407c103dcff9b Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1580899519 Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 9fadb80f21614816b3526d59b2d8a0f7 Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeNegativeTest-1580899519-project Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.480793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '42476fd8-5bc5-47f9-8aa9-da3e3012656b'} Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:11:54.481731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. Sep 13 13:11:54.483050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:11:54.485569 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] Returning 404 to user: Instance 42476fd8-5bc5-47f9-8aa9-da3e3012656b could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:11:54.486629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e8c0bafc-84e6-462c-811d-72a9b080c888 tempest-AttachVolumeNegativeTest-1580899519 tempest-AttachVolumeNegativeTest-1580899519-project] 10.222.0.72 "GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b" status: 404 len: 111 microversion: 2.1 time: 0.051596 Sep 13 13:11:54.487566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 436/891] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:54 2022] GET /compute/v2.1/servers/42476fd8-5bc5-47f9-8aa9-da3e3012656b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 13:11:54.492108 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] Creating event network-changed:e6137dd3-fadf-423f-a6c7-43a80e68f9b7 for instance 4ecc5a5a-6763-4828-8455-85170317a518 on hv-cinder-80135 Sep 13 13:11:54.497616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-482469ce-3e92-468e-9d0d-5cf4f7be5794 req-a5ec1d77-e970-40ce-9aad-dea40279ea71 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Sep 13 13:11:54.498500 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 456/892] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:11:54.680097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:54.680605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:54.686549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.687586 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.689386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:54.690274 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:54.690907 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:54.691489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:55.066788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:55.075875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f0aac601-922f-436c-a8e0-d552154d3245 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.399786 Sep 13 13:11:55.086677 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 437/893] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:54 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:56.113362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:56.117167 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:56.129434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:56.130358 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:56.131015 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:56.131805 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:56.132294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:56.132892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:56.594349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:56.603514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b139eb31-469d-41a9-ad67-55c31e6e37e0 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.507304 Sep 13 13:11:56.621191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 457/894] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:56 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:57.630072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:57.630690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:57.643221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:57.644017 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:57.644675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:57.645630 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:57.646326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:57.646753 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:58.027207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:58.037104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d6c70fe-6d2e-4b91-a8f5-e5a9435f70de tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.410911 Sep 13 13:11:58.037668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 438/895] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:57 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:11:59.061090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:11:59.065181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:11:59.065181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:11:59.070204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:59.070702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:59.071145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:59.071917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:11:59.072373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:11:59.072970 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:11:59.250539 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:11:59.260223 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2a0c150b-5f36-483f-afe5-f3ca31afa942 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.202306 Sep 13 13:11:59.260223 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 458/896] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:11:59 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:00.286641 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:00.288122 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:00.298349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:00.300576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:00.301188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:00.301757 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:00.304757 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:00.305380 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:00.306246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:00.464433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:00.472513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2b3883f4-024c-4342-bbe0-d56cb875f315 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.193673 Sep 13 13:12:00.473156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 439/897] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:00 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:01.432538 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:01.496305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:01.496980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:01.500055 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:01.500884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:01.505934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:01.506431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:01.506875 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:01.507577 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:01.508033 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:01.508464 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:01.666261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:01.676322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b7f1131e-8abf-4e4b-be1d-23efc5775da4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.184510 Sep 13 13:12:01.677423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 440/898] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:01 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:12:01.688184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a96595c3-a9c9-4de6-a735-eb240f5646af tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Action: 'create', calling method: .version_select at 0x7f1565014160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1511696609"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:01.883543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecc5a5a-6763-4828-8455-85170317a518", "name": "network-vif-plugged", "status": "completed", "tag": "e6137dd3-fadf-423f-a6c7-43a80e68f9b7"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:01.893929 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:01.894406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:01.894879 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:01.905950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] Creating event network-vif-plugged:e6137dd3-fadf-423f-a6c7-43a80e68f9b7 for instance 4ecc5a5a-6763-4828-8455-85170317a518 on hv-cinder-80135 Sep 13 13:12:01.911009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-894cee53-6dba-4d85-9db9-c174a6a479a0 req-9f38ef9d-13d2-448a-a526-8b136655a908 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031238 Sep 13 13:12:01.911618 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 441/899] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:12:02.441197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a96595c3-a9c9-4de6-a735-eb240f5646af tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.015996 Sep 13 13:12:02.441850 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 459/900] 10.222.0.72 () {60 vars in 1155 bytes} [Tue Sep 13 13:12:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1017 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 13:12:02.456383 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e1ad35ef-17b6-47cd-8444-5d51d6bdcc7a tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f6fd30>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:02.506238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e1ad35ef-17b6-47cd-8444-5d51d6bdcc7a tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 200 len: 345 microversion: 2.1 time: 0.053458 Sep 13 13:12:02.506238 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 442/901] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:02 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:02.701178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:02.701829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:02.709038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:02.709527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:02.709998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:02.710689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:02.711143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:02.711569 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:02.840191 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:02.848556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f94aca78-947a-42db-8822-f234d46f20d8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.151341 Sep 13 13:12:02.849111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 460/902] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:02 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:03.519909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a615eb6f-1a7d-448a-857c-90f0949c4dd8 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f7de50>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:03.571856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a615eb6f-1a7d-448a-857c-90f0949c4dd8 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 200 len: 346 microversion: 2.1 time: 0.056573 Sep 13 13:12:03.572427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 443/903] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:03 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:03.585610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-97188133-7dc0-4af5-8982-212b48b40ed0 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Action: 'create', calling method: .version_select at 0x7f1565014700>, body: {"snapshot": {"volume_id": "b0aea3d1-1c39-4424-9bfe-995d3eecb66a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1089630281"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:03.874400 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:03.875142 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:03.882629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:03.883126 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:03.883562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:03.884259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:03.890333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:03.890333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:04.008786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-97188133-7dc0-4af5-8982-212b48b40ed0 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.426824 Sep 13 13:12:04.009597 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 461/904] 10.222.0.72 () {60 vars in 1162 bytes} [Tue Sep 13 13:12:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:04.021851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-650d617a-615f-43e6-8f3a-a2db0dd670ea tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f97c10>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:04.023364 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:04.034011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-002e4835-be62-4d70-9a29-3b284cd4c97f tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1319 microversion: 2.1 time: 0.163635 Sep 13 13:12:04.034589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 444/905] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:03 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:04.053010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-650d617a-615f-43e6-8f3a-a2db0dd670ea tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.035203 Sep 13 13:12:04.053553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 462/906] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:04 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:12:04.065075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e22feb1d-1a47-472a-81d9-62f0555e7158 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1565094670>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:04.095177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e22feb1d-1a47-472a-81d9-62f0555e7158 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034309 Sep 13 13:12:04.095782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 445/907] 10.222.0.72 () {58 vars in 1140 bytes} [Tue Sep 13 13:12:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:04.107094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c3325926-4673-420a-b239-ebf8b9d7ba50 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564fbcee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:04.138356 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c3325926-4673-420a-b239-ebf8b9d7ba50 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.035118 Sep 13 13:12:04.138981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 463/908] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:04 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:05.058169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:05.058920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:05.069030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:05.069673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:05.070143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:05.070834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:05.071290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:05.071705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:05.153271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5e4c3f0c-f4ad-4786-9daa-0c9fb0a9c798 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1565014430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:05.193732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5e4c3f0c-f4ad-4786-9daa-0c9fb0a9c798 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.044657 Sep 13 13:12:05.194323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 464/909] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:05 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:12:05.220589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:05.228687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d84df13-7205-4b67-a26b-6cd6f868b635 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1509 microversion: 2.1 time: 0.175543 Sep 13 13:12:05.229270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 446/910] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:05 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:06.209023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c2806ee-aaf2-489e-9fe7-cfe1b95ec122 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564ff31f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:06.239887 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c2806ee-aaf2-489e-9fe7-cfe1b95ec122 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.035562 Sep 13 13:12:06.240442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 465/911] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:06 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:07.252832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d2a9d13-d142-4904-9a41-266414a347f1 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f7df70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:07.291588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d2a9d13-d142-4904-9a41-266414a347f1 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.042944 Sep 13 13:12:07.292150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 447/912] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:07 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:08.304247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-48176fd4-2cb2-4643-8fce-cb046f9c4c2b tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f15650140d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:08.340159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-48176fd4-2cb2-4643-8fce-cb046f9c4c2b tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 288 microversion: 2.1 time: 0.039545 Sep 13 13:12:08.345848 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 466/913] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:08 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:08.353769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d106e2d7-d578-4569-8d7a-6c374bb643a0 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f6f940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:08.490756 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d106e2d7-d578-4569-8d7a-6c374bb643a0 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 202 len: 0 microversion: 2.1 time: 0.141144 Sep 13 13:12:08.491351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 448/914] 10.222.0.72 () {58 vars in 1254 bytes} [Tue Sep 13 13:12:08 2022] DELETE /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:12:08.500311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1e97413-636f-4852-8b73-86e5fff9d7d7 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564fbc820>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:08.529079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1e97413-636f-4852-8b73-86e5fff9d7d7 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 200 len: 287 microversion: 2.1 time: 0.033260 Sep 13 13:12:08.529642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 467/915] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:08 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:09.543243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dec453aa-7ced-45c7-ac8f-3cc739b8b007 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564fabca0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:09.568213 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-dec453aa-7ced-45c7-ac8f-3cc739b8b007 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] HTTP exception thrown: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dec453aa-7ced-45c7-ac8f-3cc739b8b007 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Request method failure captured: Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 HTTP/1.1 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIGhlGLyf4EpelabPtPj9Nvp_VDsZ6PeY64Ust3-CvAns_mcpLO0ZOLvywV_tzlM07acnwD2PKxjrRQH35nrjQyq65wkm2kDXbAJSmKhjElW7MpTJNoZ6LG2ku-IDNNwln6b2VfAiXxqaquRsZLVCmlYqJyTlA0N_mfZfsXquInf2c8 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:12:09.570562 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d4c1a18f2c049169915a8f3fd8a57e7", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 461a89d41f844c19969adf1193c08327 Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '71db39e0-ab12-48f0-9526-b7fd8853a2c7'} Sep 13 13:12:09.572265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. (HTTP 404) (Request-ID: req-35cf3a39-da39-4008-a9e0-85441c887571) Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.573221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:09.574492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 13:12:09.575828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-dec453aa-7ced-45c7-ac8f-3cc739b8b007 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Returning 404 to user: Snapshot 71db39e0-ab12-48f0-9526-b7fd8853a2c7 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-dec453aa-7ced-45c7-ac8f-3cc739b8b007 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7" status: 404 len: 111 microversion: 2.1 time: 0.033048 Sep 13 13:12:09.577862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 449/916] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:12:09 2022] GET /compute/v2.1/os-snapshots/71db39e0-ab12-48f0-9526-b7fd8853a2c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:12:09.582277 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e31b0e83-86be-4d6c-8bbc-6cb1c2bf9d4e tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f15650041f0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:09.773963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e31b0e83-86be-4d6c-8bbc-6cb1c2bf9d4e tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 202 len: 0 microversion: 2.1 time: 0.195853 Sep 13 13:12:09.776422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 468/917] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:12:09 2022] DELETE /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:12:09.783862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d0332d99-0446-4569-ac59-076771de297a tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f7d940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:09.832025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d0332d99-0446-4569-ac59-076771de297a tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 200 len: 345 microversion: 2.1 time: 0.052891 Sep 13 13:12:09.832593 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 450/918] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:09 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:12:10.847055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01ec4667-2512-41ee-9466-843917f30d3b tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f2c0d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:10.895627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01ec4667-2512-41ee-9466-843917f30d3b tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 200 len: 345 microversion: 2.1 time: 0.052779 Sep 13 13:12:10.895627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 469/919] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:10 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:11.910058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccf61737-5d18-46ce-92d3-759db10ca7ba tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f7df70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:11.961270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccf61737-5d18-46ce-92d3-759db10ca7ba tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 200 len: 345 microversion: 2.1 time: 0.056387 Sep 13 13:12:11.961936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 451/920] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:11 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:12.974364 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:12.975143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:12.978913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9625471-f862-44c1-9c9a-493679f1d294 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1565decee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:13.008406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-f9625471-f862-44c1-9c9a-493679f1d294 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] HTTP exception thrown: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9625471-f862-44c1-9c9a-493679f1d294 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Request method failure captured: Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a HTTP/1.1 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIGhlGLyf4EpelabPtPj9Nvp_VDsZ6PeY64Ust3-CvAns_mcpLO0ZOLvywV_tzlM07acnwD2PKxjrRQH35nrjQyq65wkm2kDXbAJSmKhjElW7MpTJNoZ6LG2ku-IDNNwln6b2VfAiXxqaquRsZLVCmlYqJyTlA0N_mfZfsXquInf2c8 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:13.010962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d4c1a18f2c049169915a8f3fd8a57e7", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 461a89d41f844c19969adf1193c08327 Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'b0aea3d1-1c39-4424-9bfe-995d3eecb66a'} Sep 13 13:12:13.012705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. (HTTP 404) (Request-ID: req-b63ab570-d914-4af7-bac8-79ba137e7280) Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.013707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:13.021963 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 13:12:13.023095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f9625471-f862-44c1-9c9a-493679f1d294 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Returning 404 to user: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f9625471-f862-44c1-9c9a-493679f1d294 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 404 len: 109 microversion: 2.1 time: 0.042468 Sep 13 13:12:13.024338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 470/921] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:12 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:12:13.031558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c9de25f-011d-4b89-8bb5-79bf7bec39ac tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1565092700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:13.059945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-6c9de25f-011d-4b89-8bb5-79bf7bec39ac tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] HTTP exception thrown: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c9de25f-011d-4b89-8bb5-79bf7bec39ac tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Request method failure captured: Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a HTTP/1.1 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIGhlGLyf4EpelabPtPj9Nvp_VDsZ6PeY64Ust3-CvAns_mcpLO0ZOLvywV_tzlM07acnwD2PKxjrRQH35nrjQyq65wkm2kDXbAJSmKhjElW7MpTJNoZ6LG2ku-IDNNwln6b2VfAiXxqaquRsZLVCmlYqJyTlA0N_mfZfsXquInf2c8 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:12:13.061917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d4c1a18f2c049169915a8f3fd8a57e7", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 461a89d41f844c19969adf1193c08327 Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'b0aea3d1-1c39-4424-9bfe-995d3eecb66a'} Sep 13 13:12:13.064129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. (HTTP 404) (Request-ID: req-00a9f123-c94d-4a92-bdd2-e3396709885b) Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.065337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 13:12:13.066989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 13:12:13.068613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6c9de25f-011d-4b89-8bb5-79bf7bec39ac tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Returning 404 to user: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:13.070173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6c9de25f-011d-4b89-8bb5-79bf7bec39ac tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 404 len: 109 microversion: 2.1 time: 0.036311 Sep 13 13:12:13.078284 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 452/922] 10.222.0.72 () {58 vars in 1248 bytes} [Tue Sep 13 13:12:13 2022] DELETE /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:12:13.086899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c8e326d-f25f-4e8e-883f-d7b4bb8d8ed6 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Calling method '.version_select at 0x7f1564f2c0d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:13.118587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-7c8e326d-f25f-4e8e-883f-d7b4bb8d8ed6 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] HTTP exception thrown: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c8e326d-f25f-4e8e-883f-d7b4bb8d8ed6 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Request method failure captured: Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a HTTP/1.1 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIGhlGLyf4EpelabPtPj9Nvp_VDsZ6PeY64Ust3-CvAns_mcpLO0ZOLvywV_tzlM07acnwD2PKxjrRQH35nrjQyq65wkm2kDXbAJSmKhjElW7MpTJNoZ6LG2ku-IDNNwln6b2VfAiXxqaquRsZLVCmlYqJyTlA0N_mfZfsXquInf2c8 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:13.120483 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d4c1a18f2c049169915a8f3fd8a57e7", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d4c1a18f2c049169915a8f3fd8a57e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 2d4c1a18f2c049169915a8f3fd8a57e7 Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-432700907 Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 461a89d41f844c19969adf1193c08327 Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotsTestJSON-432700907-project Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'b0aea3d1-1c39-4424-9bfe-995d3eecb66a'} Sep 13 13:12:13.122240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. (HTTP 404) (Request-ID: req-5d2e16b5-9fb5-47a7-ae34-37e57d725c44) Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.126969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 13:12:13.129407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 13:12:13.130776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c8e326d-f25f-4e8e-883f-d7b4bb8d8ed6 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] Returning 404 to user: Volume b0aea3d1-1c39-4424-9bfe-995d3eecb66a could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c8e326d-f25f-4e8e-883f-d7b4bb8d8ed6 tempest-VolumesSnapshotsTestJSON-432700907 tempest-VolumesSnapshotsTestJSON-432700907-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a" status: 404 len: 109 microversion: 2.1 time: 0.038838 Sep 13 13:12:13.132324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 471/923] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:13 2022] GET /compute/v2.1/os-volumes/b0aea3d1-1c39-4424-9bfe-995d3eecb66a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:12:17.300733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=7 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:17.301866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=69 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:17.306949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cb3b2ddf-058c-4c1d-8130-8f7a7843a160 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f15650925e0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:17.361204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cb3b2ddf-058c-4c1d-8130-8f7a7843a160 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/4349bd81-2c82-4ca5-934e-09498c3d5810" status: 200 len: 350 microversion: 2.1 time: 0.060979 Sep 13 13:12:17.361947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 453/924] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:17 2022] GET /compute/v2.1/os-volumes/4349bd81-2c82-4ca5-934e-09498c3d5810 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:19.035339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-248e30ac-687f-452e-b1d6-928a4cb500fe tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1564f2c430>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:19.085088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-248e30ac-687f-452e-b1d6-928a4cb500fe tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/55d860a7-edd3-4c4e-bded-f2a66d555765" status: 200 len: 350 microversion: 2.1 time: 0.055274 Sep 13 13:12:19.085731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 472/925] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:19 2022] GET /compute/v2.1/os-volumes/55d860a7-edd3-4c4e-bded-f2a66d555765 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:20.777632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-699a5aae-4853-4ec9-aa40-a13cc7f6ffaa tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1564f7d940>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:20.828079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-699a5aae-4853-4ec9-aa40-a13cc7f6ffaa tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/0f9508b0-3a9c-4003-930b-66b62b22accb" status: 200 len: 350 microversion: 2.1 time: 0.054636 Sep 13 13:12:20.828640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 454/926] 10.222.0.72 () {58 vars in 1245 bytes} [Tue Sep 13 13:12:20 2022] GET /compute/v2.1/os-volumes/0f9508b0-3a9c-4003-930b-66b62b22accb => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:12:20.843241 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-157fdeb1-9de3-4a12-89e7-82024b661ff4 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1565014ee0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:20.927443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-157fdeb1-9de3-4a12-89e7-82024b661ff4 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088602 Sep 13 13:12:20.928011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 473/927] 10.222.0.72 () {58 vars in 1134 bytes} [Tue Sep 13 13:12:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:20.943563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b5f0e780-2ef0-429a-b290-5950330d3d86 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1564f7d8b0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.026705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b5f0e780-2ef0-429a-b290-5950330d3d86 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087741 Sep 13 13:12:21.027328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 455/928] 10.222.0.72 () {58 vars in 1149 bytes} [Tue Sep 13 13:12:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:21.041613 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db613984-bbe9-4cbd-b9d4-82659d94ae43 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f15650a58b0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.129548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db613984-bbe9-4cbd-b9d4-82659d94ae43 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091550 Sep 13 13:12:21.130195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 474/929] 10.222.0.72 () {58 vars in 1134 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:21.144419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d24d1625-e6f6-4008-871c-547c7c6b0489 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f15689479d0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.226167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d24d1625-e6f6-4008-871c-547c7c6b0489 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086108 Sep 13 13:12:21.226739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 456/930] 10.222.0.72 () {58 vars in 1167 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:21.241222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4b74e5cf-3af2-4299-9f58-46540a4a73ea tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f15650a59d0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.326247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4b74e5cf-3af2-4299-9f58-46540a4a73ea tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089393 Sep 13 13:12:21.327110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 475/931] 10.222.0.72 () {58 vars in 1170 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:21.341251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3cd3242c-cfe7-4760-ae5c-6ce58ffd7b99 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1568947160>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.423786 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3cd3242c-cfe7-4760-ae5c-6ce58ffd7b99 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086351 Sep 13 13:12:21.424363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 457/932] 10.222.0.72 () {58 vars in 1155 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:12:21.437674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79883d3e-281d-466c-9846-0dd5d888d4af tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1565004ca0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.521852 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79883d3e-281d-466c-9846-0dd5d888d4af tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087754 Sep 13 13:12:21.522568 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 476/933] 10.222.0.72 () {58 vars in 1188 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:21.537085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-fc5d4c59-9d10-4644-acb5-89ab31e7aa76 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] Calling method '.version_select at 0x7f1564f7d550>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:21.619501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-fc5d4c59-9d10-4644-acb5-89ab31e7aa76 tempest-VolumesTestJSON-1436518871 tempest-VolumesTestJSON-1436518871-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087005 Sep 13 13:12:21.620072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 458/934] 10.222.0.72 () {58 vars in 1155 bytes} [Tue Sep 13 13:12:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:23.925388 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:23.928133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:23.934163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:23.935679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:23.935679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:23.935914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:23.936434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:23.936867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:23.967016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4825830d-cbce-4d6d-ab20-9b36720985b9 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046752 Sep 13 13:12:23.967572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 477/935] 10.222.0.72 () {60 vars in 1343 bytes} [Tue Sep 13 13:12:23 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:24.038156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:24.038794 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:24.046141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:24.046640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:24.047082 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:24.047804 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:24.048264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:24.048691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:24.076382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:12:24.411490 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62d6add0-884e-400f-8679-1f04c885290f tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 204 len: 0 microversion: 2.20 time: 0.377329 Sep 13 13:12:24.412172 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 459/936] 10.222.0.72 () {60 vars in 1280 bytes} [Tue Sep 13 13:12:24 2022] DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 13:12:24.423443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:24.424308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:24.432010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:24.432579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:24.433024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:24.434513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:24.434513 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:24.434976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:24.579032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:24.588090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:24.589777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:24.590927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-038fb770-5c9d-4541-baea-a782681671e2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.171708 Sep 13 13:12:24.591518 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 478/937] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:24 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:12:25.620417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:25.621216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:25.628318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:25.628850 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:25.629292 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:25.630053 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:25.635179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:25.635179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:25.804400 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:25.812410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:25.813861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:25.815000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70ce4167-4f5b-43e7-8a01-e9fd670a8ac4 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1723 microversion: 2.20 time: 0.199862 Sep 13 13:12:25.815580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 460/938] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:25 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:12:26.172972 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "729a414c-56e3-4963-8fcd-b6b94637c225", "device": "/dev/sdb"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:26.176481 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:26.187152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:26.187650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:26.191829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:26.191829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:26.191829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:26.191829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:26.840970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:26.841696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:26.848729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:26.849234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:26.849669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:26.850469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:26.850869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:26.851295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:27.007662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:27.024842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:27.029972 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:27.035176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2db2ffba-c84b-4f1b-aecb-712f649c0798 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1655 microversion: 2.20 time: 0.198009 Sep 13 13:12:27.035764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 461/939] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:26 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 13:12:27.058928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f227ce-e8db-4805-9bcf-42485773201f", "name": "network-vif-deleted", "tag": "a3a407ff-7966-4a38-9817-9e291843aee0"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:27.069041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:27.069526 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:27.069985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:27.082317 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] Creating event network-vif-deleted:a3a407ff-7966-4a38-9817-9e291843aee0 for instance f7f227ce-e8db-4805-9bcf-42485773201f on hv-cinder-80135 Sep 13 13:12:27.087578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d312ccb8-535f-455d-9e16-2e34baa38c20 req-73038a55-6f7f-4b02-b767-e2dcf3bdf274 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Sep 13 13:12:27.088496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 462/940] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:27.134900 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a616dced-3323-43e3-9eae-ff33091d86e6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "POST /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965856 Sep 13 13:12:27.141625 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 479/941] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:12:26 2022] POST /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:28.063581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:28.064634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:28.072986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:28.073576 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:28.074115 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:28.074898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:28.075437 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:28.075946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:28.115080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:28.115602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:28.116090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:28.116575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lazy-loading 'fault' on Instance uuid f7f227ce-e8db-4805-9bcf-42485773201f {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:12:28.159732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:28.167897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:28.169321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe3be97820d64f85aa4d2dbd8f3ffd33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e94c8248874defa3cb01d0725dfcb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:28.170495 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-685a297e-53b8-43af-9b1d-4006215726f2 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 200 len: 1370 microversion: 2.20 time: 0.113132 Sep 13 13:12:28.186911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 463/942] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:28 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 13:12:29.208429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:29.209214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:29.217891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:29.218399 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:29.218849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:29.219560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:29.220017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:29.220452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:29.242444 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f HTTP/1.1 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:29.244565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:29.246395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'f7f227ce-e8db-4805-9bcf-42485773201f'} Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:29.247324 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:29.248865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:29.255855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:29.255855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-79ff133c-ed21-4732-bd45-df89515f66fd tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 404 len: 111 microversion: 2.20 time: 0.043144 Sep 13 13:12:29.255855 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 480/943] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:29 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 13:12:29.256858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-182ea5b9-dc87-40ab-8a88-2fb630dd5550 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '.version_select at 0x7f15650b4f70>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:29.331923 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-182ea5b9-dc87-40ab-8a88-2fb630dd5550 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618022318" status: 204 len: 0 microversion: 2.20 time: 0.079401 Sep 13 13:12:29.332605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 464/944] 10.222.0.72 () {60 vars in 1259 bytes} [Tue Sep 13 13:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618022318 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 13:12:31.629212 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:31.629750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:31.637383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:31.638719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:31.639160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:31.639867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:31.640315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:31.640918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:31.655264 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f HTTP/1.1 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:31.657051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.659472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'f7f227ce-e8db-4805-9bcf-42485773201f'} Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:31.660232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.662077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.665013 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:31.666537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4a77fe3-8c95-4c4e-be0c-390081d2e0f0 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 404 len: 111 microversion: 2.20 time: 0.041269 Sep 13 13:12:31.667913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 481/945] 10.222.0.72 () {60 vars in 1280 bytes} [Tue Sep 13 13:12:31 2022] DELETE /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:12:31.676627 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:31.677246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: f7f227ce-e8db-4805-9bcf-42485773201f] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:31.684920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:31.685413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:31.685882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:31.691177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:31.691177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:31.691177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:31.701370 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f HTTP/1.1 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:12:31.703399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.704956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'f7f227ce-e8db-4805-9bcf-42485773201f'} Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:31.706381 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. Sep 13 13:12:31.707832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:31.714717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance f7f227ce-e8db-4805-9bcf-42485773201f could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:31.714717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-729c617a-f24b-4110-af12-a97210cccf57 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f" status: 404 len: 111 microversion: 2.20 time: 0.038987 Sep 13 13:12:31.714717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 465/946] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:31 2022] GET /compute/v2.1/servers/f7f227ce-e8db-4805-9bcf-42485773201f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:12:33.060964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:33.061562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:33.068464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:33.069040 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:33.069490 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:33.070230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:33.070692 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:33.071126 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:33.084902 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 HTTP/1.1 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:33.086493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.088390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '1c784b1b-72d1-431c-bca7-12cc7f5aa2b8'} Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:33.089343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.093686 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.094936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:33.094936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1df84efc-db5d-4028-8417-319aa602ece3 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 404 len: 111 microversion: 2.20 time: 0.031826 Sep 13 13:12:33.094936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 482/947] 10.222.0.72 () {60 vars in 1280 bytes} [Tue Sep 13 13:12:33 2022] DELETE /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:12:33.101593 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:33.102819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] [instance: 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:33.109535 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:33.110093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:33.110537 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:33.111239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:33.111836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:33.113506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:33.127365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] HTTP exception thrown: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Request method failure captured: Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 HTTP/1.1 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIAJipbcoX9bf34ROGfNgGQ0dWs-AQjIgfnPOofUhbCcIO6bg2_B7i2nmW94wmx8w9QKj3EgY1wvJp9M0Vg6g1ITzMT4yNTocAU8day_S97HPDW2SR6aoHo0s-D5yEca6GZ1NOj-mIiXL3H0cs0aondva8s0flJ9NEi-KmJO8iCsuMo Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:12:33.129549 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a4e94c8248874defa3cb01d0725dfcb0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a4e94c8248874defa3cb01d0725dfcb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: a4e94c8248874defa3cb01d0725dfcb0 Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-444421162 Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: fe3be97820d64f85aa4d2dbd8f3ffd33 Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-AttachVolumeShelveTestJSON-444421162-project Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.131234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '1c784b1b-72d1-431c-bca7-12cc7f5aa2b8'} Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:33.132043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. Sep 13 13:12:33.133209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:12:33.134492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] Returning 404 to user: Instance 1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:33.134492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b34530a-6f6d-4a7f-a814-921759e1bf92 tempest-AttachVolumeShelveTestJSON-444421162 tempest-AttachVolumeShelveTestJSON-444421162-project] 10.222.0.72 "GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8" status: 404 len: 111 microversion: 2.20 time: 0.034734 Sep 13 13:12:33.134492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 466/948] 10.222.0.72 () {60 vars in 1277 bytes} [Tue Sep 13 13:12:33 2022] GET /compute/v2.1/servers/1c784b1b-72d1-431c-bca7-12cc7f5aa2b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 13:12:52.591086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:52.592533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:52.598868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:52.599520 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:52.603253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:52.603752 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:52.604177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:52.604880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:52.605331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:52.605781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:52.699255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lazy-loading 'services' on Instance uuid 4ecc5a5a-6763-4828-8455-85170317a518 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:12:53.132934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c69cb50-67ed-4a8b-9fae-c22a6fbb5e1c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518/os-volume_attachments/729a414c-56e3-4963-8fcd-b6b94637c225" status: 202 len: 0 microversion: 2.1 time: 0.547024 Sep 13 13:12:53.137242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 483/949] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:12:52 2022] DELETE /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518/os-volume_attachments/729a414c-56e3-4963-8fcd-b6b94637c225 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:12:54.261631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:54.263030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:54.265811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:54.266757 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:12:54.272015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:54.272501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:54.273129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:54.273855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:54.274909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:54.275387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:54.305953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:12:54.709714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3ed47a02-55dc-4462-b5eb-b2363b0e575a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 204 len: 0 microversion: 2.1 time: 0.451999 Sep 13 13:12:54.710350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 467/950] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:12:54 2022] DELETE /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:12:54.727499 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:54.728204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:54.734789 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:54.735283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:54.735780 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:54.736473 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:54.736933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:54.737363 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:54.901061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:54.909128 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-38f9ca54-5ecc-499b-94fc-b899b22351ef tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1515 microversion: 2.1 time: 0.186770 Sep 13 13:12:54.909711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 484/951] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:54 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:55.933186 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:55.933925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:55.943492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:55.944000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:55.944461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:55.945146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:55.945605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:55.946100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:56.085272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:56.093485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-969ae33f-22ec-4461-b4da-0a5c941d8f19 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1515 microversion: 2.1 time: 0.164903 Sep 13 13:12:56.094277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 468/952] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:55 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:56.952026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecc5a5a-6763-4828-8455-85170317a518", "name": "network-vif-deleted", "tag": "e6137dd3-fadf-423f-a6c7-43a80e68f9b7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:12:56.962435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:56.962914 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:56.963349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:56.974543 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] Creating event network-vif-deleted:e6137dd3-fadf-423f-a6c7-43a80e68f9b7 for instance 4ecc5a5a-6763-4828-8455-85170317a518 on hv-cinder-80135 Sep 13 13:12:56.979415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-8cfb21e7-99b4-4d69-98fb-c05e95de51e4 req-64ba7054-6796-493c-b3de-866387c94df2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Sep 13 13:12:56.980073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 485/953] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:12:57.116376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:57.116987 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:57.128350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:57.129515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:57.130005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:57.130725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:57.131179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:57.131596 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:57.201891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:12:57.210755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8d6973f2-3c6a-48d0-bcde-653e9cc3f8e3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 200 len: 1304 microversion: 2.1 time: 0.098085 Sep 13 13:12:57.211876 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 469/954] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:57 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:12:58.236882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:12:58.238726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 4ecc5a5a-6763-4828-8455-85170317a518] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:12:58.245038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:58.245524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:58.246226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:58.252280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:12:58.252280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:12:58.252280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:12:58.263137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] HTTP exception thrown: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Request method failure captured: Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 HTTP/1.1 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIGTecbOcbgmBBMwNZAz0Xwd4i_oxYuRzkERSmpbG-nTCP5TxG5TT5PEDHHJg1GTqgq4rkC-D3GkTib2FjSgvprCxjOad4FxKBX9dXkOb5S1YOvfu_wGzBxJFDOSbRaCjWjY11pWbKCeY-YzpSd3CQ2YyRJmkW1De_PM9mWx0khAvVw Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 15bcfc71833149c194401e5afb6e5d18 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:12:58.264709 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_15bcfc71833149c194401e5afb6e5d18", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 15bcfc71833149c194401e5afb6e5d18 Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotTestJSON-834120315-project Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 81634611141f4909a52ac46d5164f17f Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotTestJSON-834120315-project Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. Sep 13 13:12:58.266206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '4ecc5a5a-6763-4828-8455-85170317a518'} Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:12:58.267033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. Sep 13 13:12:58.268276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:12:58.269995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Returning 404 to user: Instance 4ecc5a5a-6763-4828-8455-85170317a518 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:12:58.269995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db5f1208-822b-45ef-9f03-e6fe3d9c6295 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518" status: 404 len: 111 microversion: 2.1 time: 0.034137 Sep 13 13:12:58.269995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 486/955] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:12:58 2022] GET /compute/v2.1/servers/4ecc5a5a-6763-4828-8455-85170317a518 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:13:01.263144 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:01.264762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:01.277348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:01.278171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:01.278909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:01.280077 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:01.280858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:01.281841 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:01.326232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:13:01.611784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:01.624376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:01.630869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:01.630869 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:01.643824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] Creating event network-changed:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:13:01.650180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-bf7b4296-d171-4a53-9d13-6c52a28fd84f req-c995cf7d-0e3a-47ae-aa17-52b05ade0c91 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393099 Sep 13 13:13:01.651258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 487/956] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:01.706546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4bd6d3b-fa20-4a1c-90e9-f9d7dfde5fe4 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 204 len: 0 microversion: 2.1 time: 0.450774 Sep 13 13:13:01.709353 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 470/957] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:13:01 2022] DELETE /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 13:13:01.717154 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:01.717917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:01.724740 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:01.725302 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:01.725834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:01.726878 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:01.727614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:01.728121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:01.876849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:01.886070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-01e6f961-f1ae-4799-a9b7-ca8c36e63965 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.173133 Sep 13 13:13:01.887297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 488/958] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:01 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:02.911131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:02.911897 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:02.918321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:02.918808 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:02.919246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:02.919937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:02.920416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:02.920820 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:03.126420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:03.134659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f411935-1c8d-45b7-8b77-5cca85ea357e tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1567 microversion: 2.1 time: 0.228759 Sep 13 13:13:03.135214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 471/959] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:02 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:04.160308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:04.161373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:04.168301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:04.168990 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:04.169967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:04.170886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:04.171712 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:04.172339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:04.198349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54284e3-c8b5-4ca1-8fba-355677093187", "name": "network-vif-deleted", "tag": "8e930901-ec1d-472f-b5bb-13698d503229"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:04.208774 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:04.209253 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:04.209684 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:04.237312 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] Creating event network-vif-deleted:8e930901-ec1d-472f-b5bb-13698d503229 for instance d54284e3-c8b5-4ca1-8fba-355677093187 on hv-cinder-80135 Sep 13 13:13:04.243415 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-27a0ee28-2917-4837-80a9-03aa6ff6ccc4 req-4ec97018-30af-4eaf-8cee-541bc1a56c94 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048752 Sep 13 13:13:04.244227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 472/960] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:13:04.256364 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:04.264279 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc29a325-5dcf-43d9-9db0-631089124719 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1381 microversion: 2.1 time: 0.108743 Sep 13 13:13:04.264849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 489/961] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:04 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1381 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:05.289732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:05.290485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:05.297483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:05.298003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:05.298440 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:05.299143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:05.299598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:05.300021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:05.392659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:05.408059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-948bfd8f-94f3-4cc1-a562-c8fa43599896 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1381 microversion: 2.1 time: 0.123322 Sep 13 13:13:05.408624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 473/962] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:05 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1381 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:06.431675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:06.432295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:06.439030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:06.439541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:06.439962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:06.440964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:06.441544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:06.442089 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:06.511582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:06.520651 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7f86b7e6-b1b8-4193-8ac3-4ac303f4255d tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1381 microversion: 2.1 time: 0.092900 Sep 13 13:13:06.523164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 490/963] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:06 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1381 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:07.545829 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:07.550979 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:07.554349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:07.554844 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:07.555348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:07.556108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:07.556571 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:07.557003 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:07.629372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:07.638222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-61293c4c-e809-414b-bc0c-7f74da40d06a tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1218 microversion: 2.1 time: 0.095420 Sep 13 13:13:07.638222 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 474/964] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:07 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:08.074638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1388185876", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "networks": [{"uuid": "eec74a46-1341-4521-af9d-fbe61d5591cd"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:08.150104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] validate_networks() for [('eec74a46-1341-4521-af9d-fbe61d5591cd', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:13:08.677452 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:08.678695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:08.702744 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:08.703944 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:08.704963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:08.706996 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:08.708125 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:08.709176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:08.758176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:08.758849 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:08.759279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:08.759905 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lazy-loading 'fault' on Instance uuid d54284e3-c8b5-4ca1-8fba-355677093187 {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:13:08.826103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4690104f5bea480d87b7c43488182441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9788b5b66a0c452cb39b263ca30284e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:08.835496 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5d37a7ee-ea2e-4b47-8199-3a3e5e64d9d7 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 200 len: 1223 microversion: 2.1 time: 0.163848 Sep 13 13:13:08.836076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 475/965] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:08 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:08.845879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:13:08.845879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:13:08.846403 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:13:08.846888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:13:08.848019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:13:08.859890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:08.860699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:08.861196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:08.862231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:08.863231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:08.863875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:08.887092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Getting quotas for project 15bcfc71833149c194401e5afb6e5d18. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:13:08.892352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Getting quotas for user 81634611141f4909a52ac46d5164f17f and project 15bcfc71833149c194401e5afb6e5d18. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:13:08.905810 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:13:08.908698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:13:09.134954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4140ac22-e071-4bb2-aea2-3edeb0563fc2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067278 Sep 13 13:13:09.135933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 491/966] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:13:09.147836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9436cf28-cb6a-40a6-aa2b-fa26f0e4ff91 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:09.148445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9436cf28-cb6a-40a6-aa2b-fa26f0e4ff91 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:09.210283 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9436cf28-cb6a-40a6-aa2b-fa26f0e4ff91 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:09.217277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9436cf28-cb6a-40a6-aa2b-fa26f0e4ff91 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1219 microversion: 2.1 time: 0.074146 Sep 13 13:13:09.217858 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 476/967] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:09 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:09.861203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:09.862036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] [instance: d54284e3-c8b5-4ca1-8fba-355677093187] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:09.870025 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:09.870691 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:09.871226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:09.872122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:09.872859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:09.873429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:09.890906 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] HTTP exception thrown: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Request method failure captured: Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 HTTP/1.1 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIBz5PbqdmehUB1HLvy2BMCbU6c-75W0LPQpIgXHnvfkbnJjWaE3At7LLr7RVFmMl6WIkCKhEfITDq9IXNmSq964Qe-yZSh-WSvp5tGQlHpIwPmgPqtrhC7Xe1b0Ui--myqJc0e0xHF9cy15YWf7jLE6rdq0Muzgs2w0M2kDBGm8rRc Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 9788b5b66a0c452cb39b263ca30284e0 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-TestShelveInstance-1663660965 Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:13:09.892933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9788b5b66a0c452cb39b263ca30284e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9788b5b66a0c452cb39b263ca30284e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9788b5b66a0c452cb39b263ca30284e0", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9788b5b66a0c452cb39b263ca30284e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-TestShelveInstance-1663660965 Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 9788b5b66a0c452cb39b263ca30284e0 Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestShelveInstance-1663660965 Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-TestShelveInstance-1663660965-project Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 4690104f5bea480d87b7c43488182441 Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-TestShelveInstance-1663660965-project Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. Sep 13 13:13:09.899452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': 'd54284e3-c8b5-4ca1-8fba-355677093187'} Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:13:09.901158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. Sep 13 13:13:09.902737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:13:09.904131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Returning 404 to user: Instance d54284e3-c8b5-4ca1-8fba-355677093187 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:13:09.904131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b1b1e8ea-93c5-48fb-ab4c-a9e6c9f6ec22 tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187" status: 404 len: 111 microversion: 2.1 time: 0.038539 Sep 13 13:13:09.904131 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 492/968] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:09 2022] GET /compute/v2.1/servers/d54284e3-c8b5-4ca1-8fba-355677093187 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:13:10.151216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-84a35f2e-25bc-4ad4-aceb-5187801cc59f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] Calling method '.version_select at 0x7f15650e7700>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:10.240874 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:10.242117 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:10.248894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:10.249377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:10.249839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:10.250534 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:10.250984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:10.251405 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:10.256359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-84a35f2e-25bc-4ad4-aceb-5187801cc59f tempest-TestShelveInstance-1663660965 tempest-TestShelveInstance-1663660965-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-474635815" status: 202 len: 0 microversion: 2.1 time: 0.109121 Sep 13 13:13:10.257633 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 477/969] 10.222.0.72 () {58 vars in 1251 bytes} [Tue Sep 13 13:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-474635815 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:13:10.329592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:10.338300 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-96e938c1-4123-4b1c-ac76-d6f66a4498a8 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1223 microversion: 2.1 time: 0.102457 Sep 13 13:13:10.338891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 493/970] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:10 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:11.362019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:11.362710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:11.368774 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:11.369341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:11.369878 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:11.370568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:11.375111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:11.375111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:11.432790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:11.440365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-300bdb9a-b474-4a78-9c65-32cae1c5d956 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1223 microversion: 2.1 time: 0.082705 Sep 13 13:13:11.441509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 478/971] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:11 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:12.470367 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:12.474100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:12.488732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:12.489244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:12.489711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:12.490521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:12.490982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:12.491411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:12.571423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:12.599365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a1fb731c-3043-4893-9b7d-96466d79ba9b tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1215 microversion: 2.1 time: 0.138079 Sep 13 13:13:12.599967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 494/972] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:12 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:12.812821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-718254389", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:12.892977 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] validate_networks() for None {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:13:13.259021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:13:13.259021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:13:13.259021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:13:13.259021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:13:13.259021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:13:13.275684 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:13.276210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:13.281564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:13.281564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:13.281564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:13.281564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:13.298132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Getting quotas for project a26d0a86c9d54012b058c7127cc71ecd. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:13:13.310768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Getting quotas for user 833622fc7358412ba4c0c092ee8bbb61 and project a26d0a86c9d54012b058c7127cc71ecd. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:13:13.315442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:13:13.318670 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:13:13.507032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-491f0da1-5b4d-407f-922f-70236e314aa1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698214 Sep 13 13:13:13.507713 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 479/973] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:13:13.519704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-51891695-3c88-4c88-8934-a12755a5b473 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:13.520339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-51891695-3c88-4c88-8934-a12755a5b473 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:13.627859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:13.633148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-51891695-3c88-4c88-8934-a12755a5b473 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:13.642871 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-51891695-3c88-4c88-8934-a12755a5b473 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1214 microversion: 2.1 time: 0.127647 Sep 13 13:13:13.661338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:13.677476 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 495/974] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:13 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:13.681066 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:13.683682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:13.684143 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:13.686007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:13.689181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:13.689637 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:13.861974 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:13.872271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7898d53d-3f9c-4b85-894e-b1d1260e4b2a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1279 microversion: 2.1 time: 0.248656 Sep 13 13:13:13.874173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 480/975] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:13 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:14.669069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5d8c6d3b-b616-4e46-94b1-e52a2ad93515 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:14.670309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5d8c6d3b-b616-4e46-94b1-e52a2ad93515 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:14.729909 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5d8c6d3b-b616-4e46-94b1-e52a2ad93515 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:14.737144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5d8c6d3b-b616-4e46-94b1-e52a2ad93515 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1214 microversion: 2.1 time: 0.072878 Sep 13 13:13:14.737836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 496/976] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:14 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:14.900100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:14.901634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:14.910579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:14.911485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:14.912041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:14.912981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:14.913531 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:14.914216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:15.142422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:15.153585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-30e5a3d0-cdf3-4a58-ae52-ed4b44ba2ca2 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.258013 Sep 13 13:13:15.157784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 481/977] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:14 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:15.761280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:15.762534 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:15.769459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:15.770360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:15.770799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:15.771557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:15.772200 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:15.772694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:15.867252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:15.875348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ee3f9b-c5a9-4018-8f8e-4d7499971f8a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1266 microversion: 2.1 time: 0.119190 Sep 13 13:13:15.876127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 497/978] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:15 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:16.176666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:16.177469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:16.183920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:16.184399 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:16.184832 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:16.185543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:16.186034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:16.186441 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:16.553612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:16.561237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-739664d4-1aa7-4b84-b3ca-c6b6d483e1d4 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.388711 Sep 13 13:13:16.561925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 482/979] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:16 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:16.902313 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:16.903813 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:16.911253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:16.911947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:16.912380 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:16.913302 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:16.913785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:16.914423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:16.987851 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:16.995572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e468a9d0-6bdc-4f01-92f4-6723e38a08cf tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1272 microversion: 2.1 time: 0.097217 Sep 13 13:13:16.996132 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 498/980] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:16 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:17.035959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6935da72-6ad7-49cd-8297-b30f11ba00f9", "tag": "fb3ca08f-0729-4475-9313-aa32b2d0a159"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:17.045574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:17.046092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:17.046541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:17.050864 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:17.058190 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] Creating event network-changed:fb3ca08f-0729-4475-9313-aa32b2d0a159 for instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 on hv-cinder-80135 Sep 13 13:13:17.063306 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6b973ff3-9ce3-40fd-a027-7b35c7384579 req-eaac12d5-fce0-48b2-9d31-ef6a7e43695c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Sep 13 13:13:17.064075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 483/981] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:13:17.585414 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:17.586329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:17.601802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:17.602318 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:17.605311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:17.605311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:17.605311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:17.605311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:18.022074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:18.022776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:18.033094 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:18.034079 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:18.035662 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:18.036702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:18.037350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:18.037970 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:18.349652 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:18.358412 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0376fc1c-a045-46b2-9ba4-dc823d03d9fd tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.777392 Sep 13 13:13:18.359017 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 499/982] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:17 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:18.404695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:18.415335 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-53d34934-04c5-486c-9dd5-fbbb3f24be76 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1272 microversion: 2.1 time: 0.399338 Sep 13 13:13:18.415922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 484/983] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:18 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1272 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:19.384511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:19.385203 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:19.391828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:19.395063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:19.403023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:19.403023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:19.403023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:19.403023 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:19.403632 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:19.438727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:19.439378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:19.446202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:19.446951 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:19.447559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:19.448435 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:19.449061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:19.450548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:19.626416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:19.635260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-275793d5-459f-42f3-9c28-ea6a8c777571 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.257178 Sep 13 13:13:19.636553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 500/984] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:19 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:19.660778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:19.672193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9b049648-47fe-4c57-a73d-6109c80b8318 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.237432 Sep 13 13:13:19.681980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 485/985] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:19 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:20.665462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:20.667298 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:20.700105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:20.700933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:20.708347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:20.711566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:20.712090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:20.713310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:20.722376 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:20.722906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:20.731155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:20.733601 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:20.734093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:20.734850 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:20.736460 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:20.736888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:21.141406 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:21.150505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bc303abe-1beb-45d7-8079-7cc046b4fa21 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.455231 Sep 13 13:13:21.151093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 486/986] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:20 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:21.166366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:21.178455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f8f44ab4-bbec-4a3f-a510-3139f871c16c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.514689 Sep 13 13:13:21.187859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 501/987] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:20 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:21.769256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b9a8ab-2ba5-42e5-9305-98a14390e565", "tag": "3918973e-3e0b-48f3-a3d4-bacb4c00c568"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:21.781346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:21.781986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:21.784851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:21.794513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] Creating event network-changed:3918973e-3e0b-48f3-a3d4-bacb4c00c568 for instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 on hv-cinder-80135 Sep 13 13:13:21.804080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-cc5cbda7-92b8-4eeb-b88b-443fcc858706 req-68eeef0b-36b1-492a-a7b0-0f201cec29ae service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038368 Sep 13 13:13:21.804908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 487/988] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:22.175584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:22.176178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:22.187035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:22.187591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:22.188158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:22.188992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:22.189529 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:22.190079 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:22.200865 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:22.201593 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:22.214305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:22.214824 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:22.215265 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:22.217247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:22.217914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:22.218504 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:22.493916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:22.501441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c224fa9f-454c-4b92-9f03-17b4ed9fe6de tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.330337 Sep 13 13:13:22.502036 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 502/989] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:22 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:22.521871 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:22.530157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4ad33f4d-635b-4633-9d96-3545e055864e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.334424 Sep 13 13:13:22.530986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 488/990] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:22 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:23.526122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:23.526610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:23.528870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:23.534596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:23.535096 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:23.537331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:23.537331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:23.537331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:23.537331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:23.555681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:23.560518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:23.560518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:23.560518 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:23.567428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:23.567941 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:23.568417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:23.569160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:23.569750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:23.570124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:23.794466 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:23.802726 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:23.812179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7a09620c-15df-4c35-8efc-4dc921a3deb3 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.290108 Sep 13 13:13:23.813006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 503/991] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:23 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:23.819762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-467c7e23-e500-45c8-8adb-cd3379ab3c94 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.269715 Sep 13 13:13:23.820802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 489/992] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:23 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:24.792001 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:24.797567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6935da72-6ad7-49cd-8297-b30f11ba00f9", "name": "network-vif-plugged", "status": "completed", "tag": "fb3ca08f-0729-4475-9313-aa32b2d0a159"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:24.808137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:24.808618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:24.809181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:24.812857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:24.820983 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] Creating event network-vif-plugged:fb3ca08f-0729-4475-9313-aa32b2d0a159 for instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 on hv-cinder-80135 Sep 13 13:13:24.826301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ba23b393-3833-4f93-9b77-1854c569f607 req-f9579d23-8297-4656-baf7-2bb44182914f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035591 Sep 13 13:13:24.827008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 504/993] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:24.843760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:24.844387 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:24.850008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:24.850728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:24.851790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:24.852296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:24.860855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:24.860855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:24.860855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:24.860855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:24.861310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:24.861310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:24.861310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:24.861310 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:24.861666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:24.861666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:25.080395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:25.086260 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:25.097192 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b2efdf1c-0baa-495e-9cf7-138b387b4c8c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.256249 Sep 13 13:13:25.097395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ba904af-6352-4bbf-a281-e1d7d6c0d2a5 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.250815 Sep 13 13:13:25.098489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 490/994] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:24 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:25.098711 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 505/995] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:24 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:26.120605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:26.121216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:26.121913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:26.122676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:26.128432 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:26.128884 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:26.133513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:26.133667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:26.134050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:26.134160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:26.134249 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:26.134341 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:26.134449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:26.134558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:26.134558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:26.134558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:26.347457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:26.357685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a25936f-8449-4505-91a8-2b0f239d589e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.241036 Sep 13 13:13:26.358298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 491/996] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:26 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:26.374182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:26.382384 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-651426fc-14eb-4b6a-8292-54df3a48487e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1319 microversion: 2.1 time: 0.264632 Sep 13 13:13:26.382940 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 506/997] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:26 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:27.381082 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:27.382337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:27.384636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:27.389179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.389661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.390124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:27.390835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.391266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.391681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:27.404520 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:27.409308 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:27.411986 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.412485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.412921 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:27.413614 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.414094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.414524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:27.602966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:27.606861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:27.610932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1c67ebf0-9774-4dad-a7d6-ba5395db7fbe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.234256 Sep 13 13:13:27.611590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 492/998] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:27 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:27.615666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b0c29aaa-cf6b-4c7a-97b9-fa6f2f4fcb41 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1508 microversion: 2.1 time: 0.214945 Sep 13 13:13:27.621854 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 507/999] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:27 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:27.648298 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8545f9fb-cf4d-44e5-b6a8-d789d1eecb6f", "device": "/dev/sdb"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:27.651157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:27.657617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.658129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.658570 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:27.660317 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:27.663147 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:27.663147 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:28.361251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-62f9eb23-6f9e-446b-bdb2-0e9f61ffd3c3 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "POST /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717641 Sep 13 13:13:28.362424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 493/1000] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:13:27 2022] POST /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:28.635880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:28.636836 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:28.646332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:28.647059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:28.647713 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:28.648747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:28.649458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:28.650047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:28.783630 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:28.791491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2c7c88b2-7ea6-48dd-9d21-1d41582bdbd8 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.159757 Sep 13 13:13:28.792044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 508/1001] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:28 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:29.814976 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:29.815696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:29.822563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:29.823029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:29.823458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:29.824135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:29.824582 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:29.825000 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:29.960263 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:29.969360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-495fefae-aab4-4116-b642-ebfe49538066 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.158538 Sep 13 13:13:29.970209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 494/1002] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:29 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:30.702132 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b9a8ab-2ba5-42e5-9305-98a14390e565", "name": "network-vif-plugged", "status": "completed", "tag": "3918973e-3e0b-48f3-a3d4-bacb4c00c568"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:30.727657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:30.727657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:30.727657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:30.727657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] Creating event network-vif-plugged:3918973e-3e0b-48f3-a3d4-bacb4c00c568 for instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 on hv-cinder-80135 Sep 13 13:13:30.729685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-cab9c5dc-bffc-4493-9187-3296c63d2048 req-798e92e6-4656-48bf-bbe6-70737b1fda67 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Sep 13 13:13:30.730288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 509/1003] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:30.994533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:30.995149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:31.001669 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:31.002179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:31.002613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:31.003816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:31.004329 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:31.004775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:31.130514 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:31.138111 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a2a29488-5c88-42bf-978f-6afa912c8efe tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.147439 Sep 13 13:13:31.138672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 495/1004] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:30 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:32.162370 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:32.163110 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:32.170293 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:32.170788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:32.171242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:32.171937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:32.172383 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:32.172806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:32.317566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:32.325685 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a699007a-ec3a-402d-9a75-9e3f05f0d2e1 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.168231 Sep 13 13:13:32.326849 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 510/1005] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:32 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:33.352957 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:33.353574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:33.359814 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:33.363407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:33.363407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:33.363407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:33.363407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:33.364061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:33.500703 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:33.508901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96f43549-4647-4a3a-9898-d5e3cf2027f0 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1314 microversion: 2.1 time: 0.160165 Sep 13 13:13:33.513334 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 496/1006] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:33 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:34.532448 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:34.533061 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:34.539556 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:34.540034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:34.540465 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:34.541152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:34.541609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:34.542066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:34.680400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:34.688157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-05a8a221-242f-4c28-a086-95eb736e04e6 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1464 microversion: 2.1 time: 0.159809 Sep 13 13:13:34.688719 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 511/1007] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:34 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:34.735166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:34.735675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:34.742860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:34.743346 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:34.743777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:34.744462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:34.744911 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:34.745328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:34.772159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:13:35.057098 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-422be98c-3d2d-4610-a709-7eed4ab2f368 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 204 len: 0 microversion: 2.1 time: 0.325473 Sep 13 13:13:35.057687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 497/1008] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:13:34 2022] DELETE /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:13:35.066365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:35.068116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:35.072946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:35.073430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:35.073902 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:35.074599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:35.075058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:35.075482 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:35.203161 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:35.210875 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9f1b9c88-bb45-40d1-952a-c6165cc6c3b9 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1470 microversion: 2.1 time: 0.148930 Sep 13 13:13:35.211457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 512/1009] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:35 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:36.235230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:36.235892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:36.242836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:36.243325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:36.244708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:36.244708 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:36.245202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:36.245466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:36.261281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:36.396332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:36.404457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c30cf336-bbc9-4104-aa2f-365375c6af3a tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1470 microversion: 2.1 time: 0.173676 Sep 13 13:13:36.405023 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 498/1010] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:36 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:37.348624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b9a8ab-2ba5-42e5-9305-98a14390e565", "name": "network-vif-deleted", "tag": "3918973e-3e0b-48f3-a3d4-bacb4c00c568"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:37.359146 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:37.359595 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:37.360033 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:37.377873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] Creating event network-vif-deleted:3918973e-3e0b-48f3-a3d4-bacb4c00c568 for instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 on hv-cinder-80135 Sep 13 13:13:37.384665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-eaab3b61-4838-41af-9ddf-63acdde387f3 req-b7f4790d-ac25-4833-96f1-de162ece32b2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040957 Sep 13 13:13:37.385544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 513/1011] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:37.430716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:37.431366 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:37.438106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:37.438598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:37.442391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:37.442391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:37.442391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:37.442391 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:37.520625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:37.529602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e6bf8fca-bd7d-4553-aeb6-3cd0300b7b2e tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1428 microversion: 2.1 time: 0.102906 Sep 13 13:13:37.530524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 499/1012] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:37 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:38.555698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:38.556411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:38.563455 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:38.564508 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:38.565200 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:38.567206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:38.567717 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:38.568169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:38.601676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:38.601676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:38.602141 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:38.602626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lazy-loading 'fault' on Instance uuid a1b9a8ab-2ba5-42e5-9305-98a14390e565 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:13:38.652650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833622fc7358412ba4c0c092ee8bbb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26d0a86c9d54012b058c7127cc71ecd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:38.661139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-efbf2319-7479-4766-b8c4-cadbec5cc178 tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 200 len: 1304 microversion: 2.1 time: 0.111138 Sep 13 13:13:38.661879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 514/1013] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:38 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:39.684645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:39.685172 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] [instance: a1b9a8ab-2ba5-42e5-9305-98a14390e565] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:39.691755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:39.692243 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:39.692680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:39.693369 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:39.693852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:39.694278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:39.707701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] HTTP exception thrown: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Request method failure captured: Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 HTTP/1.1 Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIHlFT1m35D-Vb5M4HFra7HwXRs-QO_9uieYZtKMh_Jo5iYi86Jgs19zC0nd20C_aVx3Pe6ZCJobYH4mrnzMGhntOkiy7EX5XCPhrCP6ZjFvccmrfSc0eTcVJuDkDn5VMMVYlwksQnEJu9EQ_cvaCHIQng0CUt9VImMQaQtYjghgXgE Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: a26d0a86c9d54012b058c7127cc71ecd Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesNegativeTest-640370746 Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:13:39.709351 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a26d0a86c9d54012b058c7127cc71ecd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a26d0a86c9d54012b058c7127cc71ecd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a26d0a86c9d54012b058c7127cc71ecd", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a26d0a86c9d54012b058c7127cc71ecd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesNegativeTest-640370746 Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: a26d0a86c9d54012b058c7127cc71ecd Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesNegativeTest-640370746 Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesNegativeTest-640370746-project Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 833622fc7358412ba4c0c092ee8bbb61 Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesNegativeTest-640370746-project Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. Sep 13 13:13:39.711074 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'a1b9a8ab-2ba5-42e5-9305-98a14390e565'} Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:13:39.711988 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. Sep 13 13:13:39.713281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:13:39.714485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] Returning 404 to user: Instance a1b9a8ab-2ba5-42e5-9305-98a14390e565 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:13:39.714485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ab1ce3c3-af14-4fc6-beeb-0168e109b6fa tempest-VolumesNegativeTest-640370746 tempest-VolumesNegativeTest-640370746-project] 10.222.0.72 "GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565" status: 404 len: 111 microversion: 2.1 time: 0.030222 Sep 13 13:13:39.714485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 500/1014] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:39 2022] GET /compute/v2.1/servers/a1b9a8ab-2ba5-42e5-9305-98a14390e565 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:13:44.337075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1629961771", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "networks": [{"uuid": "54458d17-cf99-4ceb-be5e-fa27751fbf40"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:44.400124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] validate_networks() for [('54458d17-cf99-4ceb-be5e-fa27751fbf40', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:13:44.758276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:13:44.758700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:13:44.759173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:13:44.759582 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:13:44.759994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:13:44.768579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:44.769064 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:44.769502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:44.770267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:44.770726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:44.771253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:44.788295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Getting quotas for project a5d396f1d5c14e179ab56809f912f1dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:13:44.792121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Getting quotas for user 6218b07ed7864e2589de6eff3fd1b08d and project a5d396f1d5c14e179ab56809f912f1dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:13:44.803365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:13:44.805609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:13:44.935229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d02fdd5a-5fa6-4704-874c-0ea863252133 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603324 Sep 13 13:13:44.935876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 515/1015] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:13:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:13:44.947013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2380ccff-89cd-472e-b509-1522fe0f17ae tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:44.947691 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2380ccff-89cd-472e-b509-1522fe0f17ae tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:45.001266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2380ccff-89cd-472e-b509-1522fe0f17ae tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:45.008557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2380ccff-89cd-472e-b509-1522fe0f17ae tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1214 microversion: 2.1 time: 0.065570 Sep 13 13:13:45.009264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 501/1016] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:44 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:46.032076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7503259f-3da4-4349-af23-728f7a03fae9 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:46.032722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7503259f-3da4-4349-af23-728f7a03fae9 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:46.092051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7503259f-3da4-4349-af23-728f7a03fae9 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:46.098907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7503259f-3da4-4349-af23-728f7a03fae9 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1214 microversion: 2.1 time: 0.071427 Sep 13 13:13:46.099909 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 516/1017] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:46 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:47.123639 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:47.124244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:47.133138 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:47.133663 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:47.135227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:47.136273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:47.136398 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:47.136835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:47.206784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:47.215105 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b8c1e5e0-e5e7-4720-81b8-8b4e392b298c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1218 microversion: 2.1 time: 0.095325 Sep 13 13:13:47.215689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 502/1018] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:47 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:48.238758 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:48.239512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:48.247584 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:48.248081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:48.248563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:48.249199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:48.249961 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:48.250395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:48.349622 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:48.362591 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-553c583e-5e85-4d0b-a0cb-036880f2888b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1274 microversion: 2.1 time: 0.127688 Sep 13 13:13:48.364373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 517/1019] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:48 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:49.390350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:49.390965 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:49.399131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:49.399876 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:49.400322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:49.401028 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:49.401489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:49.401943 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:49.605203 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:49.621715 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1342d567-c0f4-46db-8454-2b63e4645a65 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.235637 Sep 13 13:13:49.625033 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 503/1020] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:49 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:50.132185 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0cc6bb-60df-4c32-87ef-11ddb34a2aae", "tag": "1a335baf-4975-440e-b0bb-e486d80046d9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:50.142039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:50.142589 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:50.143092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:50.154340 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] Creating event network-changed:1a335baf-4975-440e-b0bb-e486d80046d9 for instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae on hv-cinder-80135 Sep 13 13:13:50.159941 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-557515c8-970f-4587-a981-d1410408622c req-6a1c04c9-312c-4958-9ec0-66a3520739cc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Sep 13 13:13:50.160549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 518/1021] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:50.648835 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:50.649500 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:50.656251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:50.656750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:50.657215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:50.664170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:50.664170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:50.664170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:50.800612 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:50.809615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-91ff61bb-3eb5-47fc-9061-08b8d6ef2305 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.165549 Sep 13 13:13:50.810233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 504/1022] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:50 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:51.838073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:51.838073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:51.846905 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:51.847416 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:51.847926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:51.848702 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:51.849227 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:51.849888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:52.014418 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:52.024039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-cc95971d-8238-409a-add1-8f2b916173cf tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.193319 Sep 13 13:13:52.024039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 519/1023] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:51 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:53.048041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:53.049773 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:53.058453 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:53.063040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:53.064465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:53.065286 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:53.066133 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:53.066866 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:53.370183 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:53.378615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-bf2bb461-959b-4d56-80ff-5983e89dc348 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.334692 Sep 13 13:13:53.398458 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 505/1024] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:53 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:53.988214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:53.989334 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:53.996093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:53.997507 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:53.998213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:53.998657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:53.999599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:54.000225 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:54.000819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:54.116019 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lazy-loading 'services' on Instance uuid 6935da72-6ad7-49cd-8297-b30f11ba00f9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:13:54.358366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1777912c-f6cb-4f3b-a90a-7ee3d8bf4155 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9/os-volume_attachments/8545f9fb-cf4d-44e5-b6a8-d789d1eecb6f" status: 202 len: 0 microversion: 2.1 time: 0.373836 Sep 13 13:13:54.360106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 520/1025] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:13:53 2022] DELETE /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9/os-volume_attachments/8545f9fb-cf4d-44e5-b6a8-d789d1eecb6f => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:13:54.406758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:54.407413 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:54.420801 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:54.421378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:54.421962 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:54.422887 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:54.423869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:54.424475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:54.622964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:54.631902 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cc0625f6-6448-4125-82cb-f132eea7f8ff tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.229389 Sep 13 13:13:54.649434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 506/1026] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:54 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:55.539099 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:55.542671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:55.543270 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:55.549680 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:55.550132 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:55.550571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:55.551365 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:55.552303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:55.552987 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:55.586401 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:13:55.655058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:55.658081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:55.658081 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:55.663178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:55.664416 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:55.664723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:55.665418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:55.666118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:55.666547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:55.819045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:55.827316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5b3b9188-a12d-4528-862d-c3a8cbd58579 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.176288 Sep 13 13:13:55.827876 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 507/1027] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:55 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:56.021984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3f4dd642-91b8-450a-9fc5-8ba7a1130a3c tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 204 len: 0 microversion: 2.1 time: 0.485579 Sep 13 13:13:56.022912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 521/1028] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:13:55 2022] DELETE /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:13:56.031687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:56.033922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:56.038945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:56.039541 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:56.039869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:56.040573 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:56.041032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:56.041457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:56.184747 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:56.192617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0b4b0ad0-15f7-471c-adcc-288ea3caf792 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1514 microversion: 2.1 time: 0.165380 Sep 13 13:13:56.193176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 508/1029] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:56 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:13:56.850824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:56.852730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:56.855035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=8 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:56.863240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:56.863737 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:56.864186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:56.864924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:56.865414 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:56.865873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:56.885680 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:57.053559 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:57.062217 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c99825f-05b6-4d75-9124-1bf70dcde085 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.215647 Sep 13 13:13:57.062797 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 522/1030] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:56 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:57.215476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:57.216916 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:57.224224 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:57.225087 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:57.225910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:57.227044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:57.227775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:57.228417 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:57.417830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:57.437528 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-94d7d968-f6e7-421a-b189-a3b09a020ff6 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1514 microversion: 2.1 time: 0.226122 Sep 13 13:13:57.442847 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 509/1031] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:57 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:58.087813 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:58.093657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:58.103833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:58.104393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:58.105048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:58.108447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:58.108447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:58.108447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:58.337290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6935da72-6ad7-49cd-8297-b30f11ba00f9", "name": "network-vif-deleted", "tag": "fb3ca08f-0729-4475-9313-aa32b2d0a159"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:58.357484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:13:58.360687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:58.361836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:58.362449 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:58.369860 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:58.379734 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e2af025e-7d91-4302-bb7b-2bb27ff850d5 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.296055 Sep 13 13:13:58.381305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 523/1032] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:58 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:58.402376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] Creating event network-vif-deleted:fb3ca08f-0729-4475-9313-aa32b2d0a159 for instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 on hv-cinder-80135 Sep 13 13:13:58.409096 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-d30fc56c-41ee-4d80-98f5-3367f51093de req-6a1988c6-f3c1-40b0-b2c1-4fa0686b731a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081130 Sep 13 13:13:58.410090 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 510/1033] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:58.463271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:58.464035 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:58.470663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:58.471236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:58.472058 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:58.473229 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:58.473801 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:58.474301 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:58.552105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:58.574156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-780d2bd5-679a-4a54-8b5f-3b9f475de49a tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1472 microversion: 2.1 time: 0.114259 Sep 13 13:13:58.591425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 524/1034] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:58 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1472 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:59.408602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:59.409475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:59.419895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.419895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.419895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.419895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.420402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.420402 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.492953 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0cc6bb-60df-4c32-87ef-11ddb34a2aae", "name": "network-vif-plugged", "status": "completed", "tag": "1a335baf-4975-440e-b0bb-e486d80046d9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:13:59.505124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.511261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.511261 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.532946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] Creating event network-vif-plugged:1a335baf-4975-440e-b0bb-e486d80046d9 for instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae on hv-cinder-80135 Sep 13 13:13:59.568704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-79f7b715-63e5-4033-81da-fd173545541e req-60c93b6b-f510-49c6-9cba-14ab2b2e0e09 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077025 Sep 13 13:13:59.570021 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 525/1035] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:13:59.605788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:13:59.610930 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:13:59.641583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.642904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.645783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.646743 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.648858 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.649495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.759560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:13:59.761642 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:13:59.762247 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:13:59.764047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lazy-loading 'fault' on Instance uuid 6935da72-6ad7-49cd-8297-b30f11ba00f9 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:13:59.817255 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:59.834459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0f1807e5-2fdf-49e3-9cc0-0574877906e7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.430703 Sep 13 13:13:59.836194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 511/1036] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:59 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:13:59.870398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81634611141f4909a52ac46d5164f17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bcfc71833149c194401e5afb6e5d18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:13:59.876493 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-416b067f-7009-4202-a436-8daed87dfc1e tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 200 len: 1309 microversion: 2.1 time: 0.274930 Sep 13 13:13:59.880111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 526/1037] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:13:59 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:00.865117 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:00.867920 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:00.877930 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:00.878681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:00.879128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:00.879817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:00.880266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:00.880716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:00.947971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:00.947971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] [instance: 6935da72-6ad7-49cd-8297-b30f11ba00f9] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:00.947971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:00.947971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:00.949835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:00.949835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:00.949835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:00.949835 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:00.966670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] HTTP exception thrown: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Request method failure captured: Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 HTTP/1.1 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIGTecbOcbgmBBMwNZAz0Xwd4i_oxYuRzkERSmpbG-nTCP5TxG5TT5PEDHHJg1GTqgq4rkC-D3GkTib2FjSgvprCxjOad4FxKBX9dXkOb5S1YOvfu_wGzBxJFDOSbRaCjWjY11pWbKCeY-YzpSd3CQ2YyRJmkW1De_PM9mWx0khAvVw Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: 15bcfc71833149c194401e5afb6e5d18 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:14:00.970152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_15bcfc71833149c194401e5afb6e5d18", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/15bcfc71833149c194401e5afb6e5d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: 15bcfc71833149c194401e5afb6e5d18 Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-834120315 Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesSnapshotTestJSON-834120315-project Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 81634611141f4909a52ac46d5164f17f Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesSnapshotTestJSON-834120315-project Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. Sep 13 13:14:00.972004 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '6935da72-6ad7-49cd-8297-b30f11ba00f9'} Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:14:00.973092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. Sep 13 13:14:00.974916 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:00.976557 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] Returning 404 to user: Instance 6935da72-6ad7-49cd-8297-b30f11ba00f9 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:14:00.977499 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8252ec34-923b-49c5-8efc-4c4febf5ac54 tempest-VolumesSnapshotTestJSON-834120315 tempest-VolumesSnapshotTestJSON-834120315-project] 10.222.0.72 "GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9" status: 404 len: 111 microversion: 2.1 time: 0.076666 Sep 13 13:14:00.978968 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 527/1038] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:00 2022] GET /compute/v2.1/servers/6935da72-6ad7-49cd-8297-b30f11ba00f9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:14:01.120603 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:01.129872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c64f2743-e4ad-4f22-87c8-9855f3ae9fad tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1314 microversion: 2.1 time: 0.270676 Sep 13 13:14:01.134457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 512/1039] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:00 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:02.159075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:02.160588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:02.173390 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:02.177271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:02.177271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:02.177271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:02.177271 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:02.177677 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:02.783707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:02.798885 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3c08fc93-4492-48cd-9e4d-98eb90131f20 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1499 microversion: 2.1 time: 0.644017 Sep 13 13:14:02.801820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 528/1040] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:02 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:03.871781 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:03.872898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:03.880509 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:03.881210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:03.882008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:03.882909 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:03.883680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:03.884272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:03.930207 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:14:04.259646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d2adf395-22c3-4c13-81f3-64328ec04bc8 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 204 len: 0 microversion: 2.1 time: 0.393018 Sep 13 13:14:04.267594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 513/1041] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:14:03 2022] DELETE /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:14:04.276785 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:04.279140 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:04.292458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:04.293152 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:04.293794 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:04.294824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:04.295475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:04.296076 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:04.483387 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:04.496088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dc0809a9-6b05-4931-a1f9-f5bb5089e003 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1505 microversion: 2.1 time: 0.228971 Sep 13 13:14:04.501014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 529/1042] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:04 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:05.524598 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:05.526032 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:05.537296 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:05.539030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:05.541991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:05.543037 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:05.543511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:05.545780 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:05.784148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:05.806420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e5854bb2-c2b8-4b2d-a667-222c3af8aba0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1505 microversion: 2.1 time: 0.274395 Sep 13 13:14:05.806420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 514/1043] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:05 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:06.826032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:06.828952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:06.839222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:06.840427 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:06.852413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:06.853548 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:06.854274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:06.854964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:07.148803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:07.165417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4e6e6803-9b32-494b-aaa9-55900a7eb4f0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1505 microversion: 2.1 time: 0.344559 Sep 13 13:14:07.166650 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 530/1044] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:06 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:08.192998 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:08.197775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:08.214038 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:08.214775 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:08.216235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:08.217869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:08.218645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:08.219279 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:08.282698 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:08.613369 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:08.623622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-92964b87-8fbf-44cc-a9e8-9ef7537ae1a2 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1505 microversion: 2.1 time: 0.434716 Sep 13 13:14:08.627758 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 515/1045] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:08 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:09.063194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0cc6bb-60df-4c32-87ef-11ddb34a2aae", "name": "network-vif-deleted", "tag": "1a335baf-4975-440e-b0bb-e486d80046d9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:09.098718 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:09.099280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:09.099776 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:09.112505 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] Creating event network-vif-deleted:1a335baf-4975-440e-b0bb-e486d80046d9 for instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae on hv-cinder-80135 Sep 13 13:14:09.121964 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-691535f1-b2de-4d5d-b8de-0e6ebb83d8ed req-d7de6266-caf9-485a-b18b-0d88813127ec service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061075 Sep 13 13:14:09.123020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 531/1046] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:09.655895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:09.656647 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:09.676086 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:09.676893 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:09.677557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:09.679103 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:09.679730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:09.686585 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:09.720234 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:09.720725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:09.721284 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:09.721973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lazy-loading 'fault' on Instance uuid 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:14:09.805259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:09.824433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e05986f-9445-4e56-ac67-87a6184be6fc tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 200 len: 1304 microversion: 2.1 time: 0.173013 Sep 13 13:14:09.825018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 516/1047] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:09 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:10.850745 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:10.851438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:10.861494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:10.862284 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:10.864173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:10.864173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:10.864970 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:10.865406 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:10.884378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] HTTP exception thrown: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Request method failure captured: Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae HTTP/1.1 Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIIDZi5DLRGVugx0kURGeRZPX9A9bHl9NLKJOjCzNnlOsWd5JFo18UhM10r19f4oNg6tQROzfKTJdi0lCtA8atICDydGtruRvt1rwE5XpF-A7iqXsGDqmytgFJDGJrZ2NiDhURv6TlfQiYwIly1Wauo8ooZ2ZI8Bj0Q6zrNhJmnw7Do Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: a5d396f1d5c14e179ab56809f912f1dc Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:14:10.886777 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a5d396f1d5c14e179ab56809f912f1dc", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: a5d396f1d5c14e179ab56809f912f1dc Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-VolumesActionsTest-1233350829-project Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 6218b07ed7864e2589de6eff3fd1b08d Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-VolumesActionsTest-1233350829-project Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. Sep 13 13:14:10.888533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '9d0cc6bb-60df-4c32-87ef-11ddb34a2aae'} Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:14:10.889491 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. Sep 13 13:14:10.891066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:14:10.893253 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Returning 404 to user: Instance 9d0cc6bb-60df-4c32-87ef-11ddb34a2aae could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:14:10.894378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-95e2f7c3-2a9e-4d32-9964-3e3433797b95 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae" status: 404 len: 111 microversion: 2.1 time: 0.047848 Sep 13 13:14:10.911157 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 532/1048] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:10 2022] GET /compute/v2.1/servers/9d0cc6bb-60df-4c32-87ef-11ddb34a2aae => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:14:11.124498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1623648339", "imageRef": "6ef9ea15-d3fa-46dd-a47a-12a846397cf7", "flavorRef": "452", "networks": [{"uuid": "54458d17-cf99-4ceb-be5e-fa27751fbf40"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:11.272099 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] validate_networks() for [('54458d17-cf99-4ceb-be5e-fa27751fbf40', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:14:12.218587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:14:12.219277 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:14:12.219646 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:14:12.220069 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:14:12.220489 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:14:12.244042 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:12.244446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:12.244892 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:12.250530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:12.251022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:12.253450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:12.301924 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Getting quotas for project a5d396f1d5c14e179ab56809f912f1dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:14:12.306901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Getting quotas for user 6218b07ed7864e2589de6eff3fd1b08d and project a5d396f1d5c14e179ab56809f912f1dc. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:14:12.319802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:14:12.322714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ef9ea15-d3fa-46dd-a47a-12a846397cf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:14:12.511625 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-712c2d75-7669-4df5-9599-6239c5570611 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385092 Sep 13 13:14:12.514219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 517/1049] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:14:12.526294 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-30988bd1-10b6-43e2-97aa-90edb584fde0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:12.528572 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-30988bd1-10b6-43e2-97aa-90edb584fde0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:12.680727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-30988bd1-10b6-43e2-97aa-90edb584fde0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:12.688240 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-30988bd1-10b6-43e2-97aa-90edb584fde0 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1214 microversion: 2.1 time: 0.167018 Sep 13 13:14:12.690014 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 533/1050] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:12 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:13.715443 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:13.722257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:13.734425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:13.734928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:13.735617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:13.736336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:13.736803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:13.737233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:13.831022 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:13.847252 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7a79992d-44b4-4ec4-b994-b34c0d6b0f6c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1218 microversion: 2.1 time: 0.137045 Sep 13 13:14:13.847865 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 518/1051] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:13 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:14.871059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:14.872317 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:14.882713 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:14.888219 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:14.895048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:14.896016 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:14.896768 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:14.897978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:15.040082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:15.051362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d5e8be32-6972-4ddd-a77d-16d8d2e69031 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1218 microversion: 2.1 time: 0.184035 Sep 13 13:14:15.051939 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 534/1052] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:14 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:16.074525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:16.075543 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:16.090513 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:16.096447 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:16.097029 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:16.097937 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:16.098515 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:16.099051 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:16.263041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:16.288434 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1eba7d76-4c7c-4b10-b001-718605e112c3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1218 microversion: 2.1 time: 0.216967 Sep 13 13:14:16.292727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 519/1053] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:16 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:17.316125 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:17.317347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:17.329228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:17.334726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:17.343188 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:17.346544 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:17.347044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:17.347537 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:17.537162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:17.579671 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8ea17596-9a51-498c-974a-a6195104d544 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1266 microversion: 2.1 time: 0.266639 Sep 13 13:14:17.601693 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 535/1054] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:17 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:18.173934 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-65786b4e-41bf-4940-9c02-539d3a435016 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Action: 'create', calling method: .version_select at 0x7f156513a8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1430276841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUM1Xla3da/y2N21zV494X6ZmD8MSt0bqlqljUQf1D4ILpa9dSfvik+D+F88n0ak38C5XZd21L6XoXnhe5eDkxk9s90JpG847lNLQqdtMLWHlJ/3o8qgVBAhNa+cpmUow=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:18.205345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-65786b4e-41bf-4940-9c02-539d3a435016 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:14:18.231483 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-65786b4e-41bf-4940-9c02-539d3a435016 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for user 44492f86f0cb4d4ea1fee7ea2ae7d10f and project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:14:18.459665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-65786b4e-41bf-4940-9c02-539d3a435016 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.640074 Sep 13 13:14:18.460270 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 520/1055] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:14:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:18.606315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:18.607541 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:18.617206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:18.618126 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:18.618898 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:18.619834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:18.620575 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:18.621232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:18.779441 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:18.790059 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c897d220-28bb-4198-b56c-d8e690f81e08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1272 microversion: 2.1 time: 0.188451 Sep 13 13:14:18.790982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 536/1056] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:18 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:19.827981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:19.830817 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:19.858593 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:19.859653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:19.861372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:19.864573 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:19.867375 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:19.868092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:20.121810 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:20.131863 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ba06628f-c06b-4dd6-af76-925dee1c747b tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.314659 Sep 13 13:14:20.133915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 521/1057] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:19 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:20.523073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d5008e-b793-4dfa-a480-61aa740c5861", "tag": "8f219e0a-2b4c-4cb0-a6bc-be186a880267"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:20.551344 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:20.552967 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:20.554195 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:20.581695 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] Creating event network-changed:8f219e0a-2b4c-4cb0-a6bc-be186a880267 for instance 41d5008e-b793-4dfa-a480-61aa740c5861 on hv-cinder-80135 Sep 13 13:14:20.607793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-565827a7-7ccc-40b1-ad5b-407d42ec73a6 req-29231515-2997-4165-9f61-07f09c06f098 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087766 Sep 13 13:14:20.610935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 537/1058] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:14:21.159318 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:21.160136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:21.170636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:21.173264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:21.176791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:21.177860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:21.178344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:21.183397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:21.325141 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:21.334983 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0768a339-0f2c-411c-ad39-6c6d431bac08 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.181040 Sep 13 13:14:21.335560 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 522/1059] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:21 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:22.361616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:22.362427 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:22.372144 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:22.372646 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:22.375759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:22.375759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:22.375759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:22.375759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:22.623215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96a39642-ec1e-4dee-abd3-2741c15f9620 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'create', calling method: .version_select at 0x7f15689473a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1308165583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZXhF/crbYKccoi5JJcaUJsHMkqzWIqcl+ZWIW3BwxQDKnsnRY30//zBEcpOYSCDx9JObZYLk4w4sB7qHyhhO5CZpszXNJTpH5Lg3e88UAUJZFtlgAbcyNy96jqHi1cIw=="}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:22.631772 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:22.646106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:22.655110 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-96a39642-ec1e-4dee-abd3-2741c15f9620 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Getting quotas for project aa5bc3bf3bb74d6a91e79dd861d0563f. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:14:22.659725 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-96a39642-ec1e-4dee-abd3-2741c15f9620 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Getting quotas for user ede50e164bea4a89a28e50243d145447 and project aa5bc3bf3bb74d6a91e79dd861d0563f. Resources: {'key_pairs'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:14:22.663124 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e71e1023-165e-4ef6-847f-bbce36f3c61f tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.307567 Sep 13 13:14:22.665594 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 538/1060] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:22 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:22.750767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96a39642-ec1e-4dee-abd3-2741c15f9620 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.131496 Sep 13 13:14:22.755256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 523/1061] 10.222.0.72 () {60 vars in 1159 bytes} [Tue Sep 13 13:14:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:22.858262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-180274949", "imageRef": "c87008c2-2edc-4ecd-975b-61d12a971311", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1308165583", "networks": [{"uuid": "ddb2f6ec-2cbe-46b9-865c-7cb0e7584ba8"}]}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:22.870368 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:22.916825 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.network.neutron [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] validate_networks() for [('ddb2f6ec-2cbe-46b9-865c-7cb0e7584ba8', None, None, None, None, None)] {{(pid=121103) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:14:23.584587 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Flavor limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:14:23.585197 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Image limits 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:14:23.585488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Flavor pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:14:23.585930 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Image pref 0:0:0 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:14:23.586396 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.virt.hardware [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:14:23.597941 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:23.598681 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:23.599133 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:23.599975 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:23.600640 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:23.600957 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:23.638764 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Getting quotas for project aa5bc3bf3bb74d6a91e79dd861d0563f. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:14:23.643051 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.quota [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Getting quotas for user ede50e164bea4a89a28e50243d145447 and project aa5bc3bf3bb74d6a91e79dd861d0563f. Resources: {'instances', 'cores', 'ram'} {{(pid=121103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:14:23.657654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Going to run 1 instances... {{(pid=121103) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:14:23.659959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c87008c2-2edc-4ecd-975b-61d12a971311',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:14:23.688718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:23.689544 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:23.697321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:23.697932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:23.698327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:23.698945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:23.699806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:23.700241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:23.786373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-becedf68-9b2f-4a48-b754-026b2bde6416 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931858 Sep 13 13:14:23.794306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 539/1062] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:14:23.798819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7c678b03-fc6a-4282-b642-ae40a7b4ffd9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:23.799442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7c678b03-fc6a-4282-b642-ae40a7b4ffd9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:23.874199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7c678b03-fc6a-4282-b642-ae40a7b4ffd9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:23.884603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7c678b03-fc6a-4282-b642-ae40a7b4ffd9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1258 microversion: 2.1 time: 0.089866 Sep 13 13:14:23.885231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 540/1063] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:23 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:23.885418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:23.898743 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-9582e4cb-ea20-4f68-9cc0-f6a93eb8fb0d tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.214843 Sep 13 13:14:23.899328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 524/1064] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:23 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:24.907602 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d7c480f6-1aa0-4048-b479-c59927759990 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:24.908205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d7c480f6-1aa0-4048-b479-c59927759990 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:24.910428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:24.922644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:24.924045 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:24.930649 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:24.931134 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:24.931564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:24.932256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:24.932714 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:24.933136 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:24.985634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d7c480f6-1aa0-4048-b479-c59927759990 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:24.993287 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d7c480f6-1aa0-4048-b479-c59927759990 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1258 microversion: 2.1 time: 0.089895 Sep 13 13:14:24.993966 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 541/1065] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:24 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:25.081963 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:25.090028 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c85ad62a-2a35-482b-a69c-53265a407d42 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.171078 Sep 13 13:14:25.090636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 525/1066] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:24 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:26.016386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:26.016922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:26.024982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:26.025478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:26.026028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:26.026820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:26.027186 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:26.027604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:26.093856 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:26.103736 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fe9c636c-4d76-4c15-9c46-fc13998928fd tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1310 microversion: 2.1 time: 0.091275 Sep 13 13:14:26.104330 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 542/1067] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:26 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:26.112624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:26.113241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:26.120227 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:26.120718 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:26.121420 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:26.122148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:26.122709 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:26.125101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:26.334557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:26.344664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-416d1d5e-aadf-474b-9f3a-2d3447e7e08e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.235778 Sep 13 13:14:26.345311 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 526/1068] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:26 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:27.133180 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:27.134066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:27.145135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:27.145634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:27.146106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:27.147158 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:27.148114 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:27.154653 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:27.374686 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:27.375511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:27.400557 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:27.408374 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:27.408877 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:27.410928 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:27.411587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:27.415011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:27.511786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:27.525531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-58fcae45-8ac2-41c2-86bc-cad132f1a387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.396881 Sep 13 13:14:27.539071 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 543/1069] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:27 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:27.709857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d5008e-b793-4dfa-a480-61aa740c5861", "name": "network-vif-plugged", "status": "completed", "tag": "8f219e0a-2b4c-4cb0-a6bc-be186a880267"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:27.745890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:27.745890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:27.745890 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:27.765687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] Creating event network-vif-plugged:8f219e0a-2b4c-4cb0-a6bc-be186a880267 for instance 41d5008e-b793-4dfa-a480-61aa740c5861 on hv-cinder-80135 Sep 13 13:14:27.780108 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-cef41047-1619-436c-95f5-c6492d614b8e req-9abc90a1-b315-4648-ae15-a9bd6caabdec service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077914 Sep 13 13:14:27.781521 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 544/1070] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:14:27.851652 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:27.875994 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-434d049e-cf23-4b72-858f-6c11432d3f30 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.509706 Sep 13 13:14:27.885135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 527/1071] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:27 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:28.564814 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:28.566629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:28.577428 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:28.578862 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:28.580093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:28.581226 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:28.582184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:28.583086 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:28.814235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:28.823348 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b97ee09a-6070-4519-9e90-5557a5b96883 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.265425 Sep 13 13:14:28.823867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 545/1072] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:28 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:28.838788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:28.856710 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:28.858566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:28.859654 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:28.875736 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] Creating event network-changed:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:14:28.893645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-82b8a546-2768-4e61-be43-996c90ae379b req-c121ee7e-ac1c-4bb5-88b5-0814c34622b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058911 Sep 13 13:14:28.901827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:28.902459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:28.910216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 528/1073] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:28.916701 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:28.917411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:28.922101 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:28.924077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:28.924077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:28.924373 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:28.945917 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=100 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:29.339506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:29.347946 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3088e831-4746-4b48-860f-b6aee555ab4a tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.451316 Sep 13 13:14:29.348508 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 546/1074] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:28 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:29.852644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:29.853349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:29.860682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:29.861476 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:29.862114 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:29.863071 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:29.863529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:29.863949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:30.020316 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:30.029672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-23d641b5-86ce-471f-9595-7a875b53fad6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.181899 Sep 13 13:14:30.030485 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 529/1075] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:29 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:30.372474 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:30.373087 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:30.380741 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:30.381236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:30.381690 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:30.382649 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:30.383116 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:30.383547 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:30.534331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:30.544530 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-f126ddfe-27e1-4d03-a441-f9ab7f463885 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.176006 Sep 13 13:14:30.558266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 547/1076] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:30 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:31.055281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:31.056851 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:31.059946 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:31.070005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:31.070827 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:31.071442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:31.072529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:31.073205 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:31.073854 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:31.284135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:31.292806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-96ba3510-a9a3-41f2-b72d-b1841fcca9c9 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.242320 Sep 13 13:14:31.305883 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 530/1077] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:31 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:31.568567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:31.570255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:31.578440 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:31.579283 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:31.579884 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:31.580971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:31.581624 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:31.582609 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:31.745400 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:31.760476 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fefb53f4-b800-481e-8564-4e95c93a5df3 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.195405 Sep 13 13:14:31.761857 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 548/1078] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:31 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:32.323910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:32.323910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:32.334882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:32.338510 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:32.339198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:32.340492 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:32.341200 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:32.341899 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:32.494594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:32.502290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b11307fe-bb18-4b83-b70d-773d1b593279 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.186463 Sep 13 13:14:32.503203 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 531/1079] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:32 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:32.786834 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:32.788134 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:32.794705 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:32.795230 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:32.795744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:32.796464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:32.796927 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:32.797362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:32.962010 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:32.962196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-0692cb2e-642f-4501-b331-15bdd1688dc4 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.179385 Sep 13 13:14:32.969784 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 549/1080] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:32 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:33.527225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:33.527819 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:33.529964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:33.535906 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:33.536397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:33.537695 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:33.553193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:33.553193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:33.553193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:33.687900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:33.697752 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-49c1b235-0d19-417e-b652-b2a30ae648ba tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.174271 Sep 13 13:14:33.698341 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 532/1081] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:33 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:33.987034 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:33.991732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:33.991732 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:33.996137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:33.996731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:33.997202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:33.998355 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:33.998822 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:33.999258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:34.165472 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:34.173713 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9728bcc6-7259-4f21-b515-27a9d4f52d75 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.190410 Sep 13 13:14:34.174249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 550/1082] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:33 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:34.720523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:34.721128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:34.729540 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:34.730061 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:34.730904 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:34.731776 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:34.732239 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:34.732673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:34.876876 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:34.885348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0aa7c2d7-6ddc-4c36-adde-a1548b9fd190 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.168556 Sep 13 13:14:34.898194 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 533/1083] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:34 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:35.197236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:35.197904 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:35.199861 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=10 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:35.205175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:35.205666 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:35.206156 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:35.206867 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:35.207323 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:35.207753 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:35.342772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:35.351612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c398c5c6-54d2-4ef0-9b49-07e9e29fc59c tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.158974 Sep 13 13:14:35.352184 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 551/1084] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:35 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:35.910676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:35.911359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:35.917754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:35.918248 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:35.918682 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:35.919373 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:35.919821 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:35.920237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:36.057276 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:36.059501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:36.065508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3f8d5c83-3231-4dd2-84a7-486c60712a6e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.158800 Sep 13 13:14:36.066106 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 534/1085] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:35 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:36.375155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:36.375907 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:36.382438 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:36.383912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:36.383912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:36.384135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:36.384478 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:36.384903 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:36.574112 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:36.581682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eed8f3ad-ba46-4065-83f0-94a6e4f717e1 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1314 microversion: 2.1 time: 0.210509 Sep 13 13:14:36.582269 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 552/1086] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:36 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:37.088816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:37.089425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:37.098080 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:37.098925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:37.099380 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:37.100246 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:37.100707 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:37.101135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:37.235789 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:37.244947 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-1bffbd6a-ecc9-476a-be0d-0ebff7742044 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.160251 Sep 13 13:14:37.306454 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 535/1087] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:37 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:37.605699 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:37.606361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:37.612918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:37.613413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:37.613886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:37.614593 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:37.615057 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:37.615581 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:37.752477 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:37.760430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1df3becc-9fe0-49c0-8bab-a841f03fb275 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1498 microversion: 2.1 time: 0.158583 Sep 13 13:14:37.761012 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 553/1088] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:37 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:38.267567 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:38.268180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:38.274852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:38.275330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:38.275762 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:38.276442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:38.276908 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:38.277311 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:38.415955 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:38.423674 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6d863112-3932-455b-a0df-3b491923a61a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.159861 Sep 13 13:14:38.425166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 536/1089] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:38 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:38.959665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:38.960216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:38.966524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:38.967006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:38.967442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:38.968129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:38.968583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:38.969046 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:38.995055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:14:39.280106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e375cfbc-d040-46cd-b9d4-a16d78ccd77e tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "DELETE /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 204 len: 0 microversion: 2.1 time: 0.324125 Sep 13 13:14:39.280700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 554/1090] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:14:38 2022] DELETE /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:14:39.293550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:39.293550 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:39.297257 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.297770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.298224 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:39.298916 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.299368 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.299777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:39.432197 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:39.439902 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2c343c5f-3c0a-4a0a-8139-68833b5b4cfd tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1504 microversion: 2.1 time: 0.154893 Sep 13 13:14:39.448812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:39.449531 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:39.454116 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 537/1091] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:39 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:39.455577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.456075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.456522 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:39.457224 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.457682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.458143 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:39.468927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1627571501", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1430276841", "security_groups": [{"name": "tempest-secgroup-smoke-77685047"}], "block_device_mapping_v2": [{"uuid": "2e8847a8-e6fd-49e8-8785-4edf3ba0ddc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:39.620580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:39.623059 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] validate_networks() for [('0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:14:39.628683 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5cd5bd00-49e6-4ebd-8518-2cce1ecb7317 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.185222 Sep 13 13:14:39.629357 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 555/1092] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:39 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:39.984031 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:14:39.984451 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:14:39.984949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:14:39.985356 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:14:39.985790 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:14:39.994991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.995469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.995898 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:39.996616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:39.997062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:39.997486 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:40.014297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:14:40.018229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for user 44492f86f0cb4d4ea1fee7ea2ae7d10f and project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:14:40.075461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:14:40.077620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e8847a8-e6fd-49e8-8785-4edf3ba0ddc2',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:14:40.463100 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:40.463724 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:40.470232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:40.470720 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:40.471194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:40.471891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:40.472351 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:40.472786 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:40.578764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c601bb47-cb93-4bf4-baea-edc85838afff tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.113727 Sep 13 13:14:40.586362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 538/1093] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:14:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 13:14:40.591574 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2f145c20-08c9-498a-8cc5-dcba1ab6ca2d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:40.592221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2f145c20-08c9-498a-8cc5-dcba1ab6ca2d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:40.615333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:40.624883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ffc053a3-9e10-42e2-a610-9280f71f40b7 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1504 microversion: 2.1 time: 0.165941 Sep 13 13:14:40.638060 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 556/1094] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:40 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:40.659305 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:40.659998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:40.666675 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:40.667244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:40.667911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:40.668616 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:40.669255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:40.669688 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:40.683030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2f145c20-08c9-498a-8cc5-dcba1ab6ca2d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:40.690065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2f145c20-08c9-498a-8cc5-dcba1ab6ca2d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1095 microversion: 2.1 time: 0.102255 Sep 13 13:14:40.691209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 539/1095] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:40 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:40.908228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:40.917694 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dbd4ef88-eb10-459b-b211-4351ef18c75e tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.262557 Sep 13 13:14:40.918135 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 557/1096] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:40 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:41.246933 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d5008e-b793-4dfa-a480-61aa740c5861", "name": "network-vif-deleted", "tag": "8f219e0a-2b4c-4cb0-a6bc-be186a880267"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:41.257216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.261559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.261559 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.269584 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] Creating event network-vif-deleted:8f219e0a-2b4c-4cb0-a6bc-be186a880267 for instance 41d5008e-b793-4dfa-a480-61aa740c5861 on hv-cinder-80135 Sep 13 13:14:41.275437 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-b9d95dd2-e6e3-4f91-adee-bfafc3d3bbcd req-4ca7a14b-fb14-4578-86c0-04bc5b76b797 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Sep 13 13:14:41.276027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 540/1097] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:41.652756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:41.653634 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:41.674379 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.674888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.675335 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.676480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.677008 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.678281 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.713726 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.714181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.714629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.715083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lazy-loading 'fault' on Instance uuid 41d5008e-b793-4dfa-a480-61aa740c5861 {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:14:41.715993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:41.718161 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:41.725859 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.726348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.726784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.727525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.727973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.728394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.764793 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6218b07ed7864e2589de6eff3fd1b08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d396f1d5c14e179ab56809f912f1dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:41.770700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-2fe1504a-a529-4894-a34f-e8cd285dc470 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 200 len: 1304 microversion: 2.1 time: 0.121966 Sep 13 13:14:41.771346 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 558/1098] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:41 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:41.804697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:41.812818 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-a6d6f37c-ae22-4b74-8c94-27d5bd434602 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1145 microversion: 2.1 time: 0.101107 Sep 13 13:14:41.813395 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 541/1099] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:41 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:41.940554 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:41.941295 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:41.948731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.949392 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.949840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:41.954820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:41.954820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:41.954820 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:42.080664 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:42.088395 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-887d5568-dfb6-434d-9f23-3b4356a7a15d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.151813 Sep 13 13:14:42.088952 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 559/1100] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:41 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:42.796305 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:42.796948 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] [instance: 41d5008e-b793-4dfa-a480-61aa740c5861] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:42.804240 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:42.804764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:42.805202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:42.806027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:42.806379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:42.807009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:42.821626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] HTTP exception thrown: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Request method failure captured: Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 HTTP/1.1 Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIIDZi5DLRGVugx0kURGeRZPX9A9bHl9NLKJOjCzNnlOsWd5JFo18UhM10r19f4oNg6tQROzfKTJdi0lCtA8atICDydGtruRvt1rwE5XpF-A7iqXsGDqmytgFJDGJrZ2NiDhURv6TlfQiYwIly1Wauo8ooZ2ZI8Bj0Q6zrNhJmnw7Do Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: a5d396f1d5c14e179ab56809f912f1dc Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:14:42.823309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a5d396f1d5c14e179ab56809f912f1dc", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a5d396f1d5c14e179ab56809f912f1dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: a5d396f1d5c14e179ab56809f912f1dc Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-VolumesActionsTest-1233350829 Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-VolumesActionsTest-1233350829-project Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 6218b07ed7864e2589de6eff3fd1b08d Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-VolumesActionsTest-1233350829-project Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. Sep 13 13:14:42.825313 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '41d5008e-b793-4dfa-a480-61aa740c5861'} Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:14:42.828958 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. Sep 13 13:14:42.830378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:14:42.831611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] Returning 404 to user: Instance 41d5008e-b793-4dfa-a480-61aa740c5861 could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:14:42.831611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c786355f-2072-4b30-b358-8e18e2d14d57 tempest-VolumesActionsTest-1233350829 tempest-VolumesActionsTest-1233350829-project] 10.222.0.72 "GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861" status: 404 len: 111 microversion: 2.1 time: 0.033274 Sep 13 13:14:42.831611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 542/1101] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:42 2022] GET /compute/v2.1/servers/41d5008e-b793-4dfa-a480-61aa740c5861 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:14:42.841492 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:42.842039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:42.848668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:42.849165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:42.850353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:42.851312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:42.851892 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:42.852331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:42.931410 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:42.935366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:42.939846 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-42ebbc2f-bbd7-45ac-81fc-8554b13aa929 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1201 microversion: 2.1 time: 0.102680 Sep 13 13:14:42.940623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 560/1102] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:42 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:43.111251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:43.111868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:43.118645 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:43.119133 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:43.119575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:43.120301 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:43.120755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:43.121178 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:43.620874 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:43.628842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5145d56d-78f9-4ea8-a8c7-c7dc1f503121 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.521341 Sep 13 13:14:43.635233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 543/1103] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:43 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:43.663802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "name": "network-vif-plugged", "status": "completed", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:43.671611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:43.672169 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:43.672698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:43.684031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] Creating event network-vif-plugged:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:14:43.688969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-e43c6d05-39cb-4c9f-ae66-dc0a92028121 req-c18d3954-1629-4c70-8352-4ced2c9b337b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032636 Sep 13 13:14:43.689971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 561/1104] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:43.967018 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:43.968466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:43.976522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:43.976522 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:43.976968 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:43.977919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:43.978560 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:43.979160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:44.232901 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:44.240613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d6d43e43-44b2-431c-8567-98a329521f64 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1277 microversion: 2.1 time: 0.280231 Sep 13 13:14:44.241179 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 544/1105] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:43 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:44.654104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:44.654829 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:44.662759 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:44.663244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:44.663687 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:44.664386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:44.664840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:44.665268 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:44.859731 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:44.867747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-202338dc-0aad-49d0-8b1b-d7d6074bf877 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.218877 Sep 13 13:14:44.868312 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 562/1106] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:44 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:45.267150 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:45.267754 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:45.274247 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:45.276771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:45.276771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:45.276771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:45.276771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:45.277171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:45.320433 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f1ad057-3065-45e6-91c9-fb4a53f79abb", "tag": "bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:45.329817 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:45.330296 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:45.330742 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:45.343083 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] Creating event network-changed:bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7 for instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb on hv-cinder-80135 Sep 13 13:14:45.348123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-9a9a53a6-8038-4b05-bc09-9f4156df13ef req-ce973a83-8a00-4350-9a36-e32849950128 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Sep 13 13:14:45.348714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 563/1107] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:14:45.460326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:45.467890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ebcac2f3-a2d0-4532-b92f-c95d18107669 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.204554 Sep 13 13:14:45.468450 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 545/1108] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:45 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:45.891909 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:45.892534 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:45.899262 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:45.899744 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:45.900182 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:45.900873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:45.901326 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:45.901772 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:46.031345 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:46.039638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-dcd8e6aa-7886-4f5c-a339-92f5ac22e159 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.152515 Sep 13 13:14:46.040204 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 564/1109] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:45 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:46.491619 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:46.492229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:46.498868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:46.499361 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:46.499802 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:46.500523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:46.500978 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:46.501401 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:46.629244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:46.637899 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2af82b94-50fb-4357-9fb2-ac842fe44190 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.149938 Sep 13 13:14:46.638158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 546/1110] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:46 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:47.062205 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:47.062824 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:47.069360 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:47.069888 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:47.070331 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:47.071024 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:47.071480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:47.071910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:47.196658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:47.204193 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-13e7cd92-9ac5-41e6-be24-1b7bff0e9bbf tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.145887 Sep 13 13:14:47.204755 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 565/1111] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:47 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:47.660403 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:47.661015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:47.668696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:47.669176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:47.669617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:47.670328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:47.670778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:47.671196 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:47.801209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:47.808915 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8a5e7dc3-fc62-4034-baea-6f602b79354a tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.152346 Sep 13 13:14:47.809481 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 547/1112] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:47 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:48.227833 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:48.232028 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:48.236177 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:48.236754 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:48.237181 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:48.237980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:48.238434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:48.239064 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:48.466434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:48.480889 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c0ad1951-8117-4ab6-b53e-3be9b5c4e94b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1358 microversion: 2.1 time: 0.257570 Sep 13 13:14:48.509172 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 566/1113] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:48 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:48.837494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:48.838792 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:48.847014 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:48.847495 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:48.848148 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:48.849058 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:48.850049 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:48.850482 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:49.011062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:49.021036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-7f952609-cf07-4463-bc9a-c8cc03dc4281 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.191844 Sep 13 13:14:49.022245 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 548/1114] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:48 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:49.516419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:49.517333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:49.526006 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:49.527467 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:49.527908 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:49.528954 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:49.529453 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:49.535611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:49.729078 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:49.743213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-56e53948-d331-460f-89c7-29a647f8fadc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1548 microversion: 2.1 time: 0.231094 Sep 13 13:14:49.744055 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 567/1115] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:49 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1548 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:49.767791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:49.768675 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:49.787862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:49.790622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:49.792375 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:49.794046 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:49.795108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:49.795921 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:49.960005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:49.969065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c666ddbd-b225-40ea-bd2c-31c50cb771c4 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1548 microversion: 2.1 time: 0.205073 Sep 13 13:14:49.969883 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 549/1116] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:49 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:49.994359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:49.999377 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:50.000149 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Searching by: {'deleted': False, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f'} {{(pid=121103) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 13:14:50.007969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.008698 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.009311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.010319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.010779 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.011211 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.069187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:50.070188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:50.076019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:50.081191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.081191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.081191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.081191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.081681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.081681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.118933 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.multi_cell_list [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121103) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 13:14:50.221684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b8ac2808-818e-4722-b365-1ffd02ebae35 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.231020 Sep 13 13:14:50.222529 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 568/1117] 10.222.0.72 () {58 vars in 1125 bytes} [Tue Sep 13 13:14:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:14:50.234046 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:50.234658 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:50.240700 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.241194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.241905 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.242707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:50.242836 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:50.243164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:50.243588 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:50.254861 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4d10ad54-f811-4b97-ba57-66bd695a5f53 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.190557 Sep 13 13:14:50.271760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 550/1118] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:50 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:50.415338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:50.423523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1a220d90-cb74-4d35-826d-9ccf07e2647c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1548 microversion: 2.1 time: 0.193354 Sep 13 13:14:50.424497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 569/1119] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:50 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:51.284427 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:51.285084 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:51.288955 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=8 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:51.293721 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:51.295620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:51.295620 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:51.295855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:51.296187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:51.296657 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:51.452681 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:51.461459 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-3a1e6fe0-5eda-423d-8caa-32557f532f83 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.183258 Sep 13 13:14:51.462554 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 551/1120] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:51 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:52.404025 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f3ca0e7-475d-4284-8570-2e7c2ead93f9"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:52.407202 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:52.415806 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:52.416353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:52.416816 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:52.417899 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:52.418359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:52.418792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:52.491281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:52.491993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:52.500181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:52.500181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:52.500181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:52.500499 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:52.501511 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:52.502558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:52.667378 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:52.677732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c3717c1f-539f-4c8e-a157-97ea806e3529 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.190228 Sep 13 13:14:52.688214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 552/1121] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:52 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:53.134982 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a878df88-a6c3-49e6-bea9-37ff9d3814bc tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735203 Sep 13 13:14:53.141245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 570/1122] 10.222.0.72 () {60 vars in 1323 bytes} [Tue Sep 13 13:14:52 2022] POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:53.706363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:53.707957 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:53.718642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:53.720012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:53.720638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:53.721622 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:53.723433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:53.725195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:53.891961 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:53.906525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-88a9c173-7da0-4d5f-886f-e5f000dc5a06 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.206954 Sep 13 13:14:53.907538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 553/1123] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:53 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:54.930645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:54.932048 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:54.938707 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:54.939206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:54.939648 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:54.940359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:54.940816 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:54.941252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:55.088511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:55.097088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e555eaaf-7d41-43ea-aeaa-c9867b441317 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.171481 Sep 13 13:14:55.113107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 571/1124] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:54 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:56.121798 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:56.122408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:56.130068 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:56.130895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:56.131589 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:56.132359 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:56.132890 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:56.133321 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:56.151703 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=100 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:56.564100 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:56.573991 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e7e483dd-17ff-47fb-aa10-192678e7cc3e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.457335 Sep 13 13:14:56.593169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 554/1125] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:56 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:14:56.666773 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:56.668022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:56.670637 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:14:56.676178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:56.676708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:56.677183 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:56.681873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:56.681873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:56.681873 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:56.839044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:56.862053 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-ce64b024-b75b-4029-807d-ea9fcfaf802a tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1594 microversion: 2.1 time: 0.198695 Sep 13 13:14:56.863631 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 572/1126] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:56 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1594 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:57.606523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:57.606523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:57.607307 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:57.607468 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:57.607918 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:57.608672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:57.609343 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:57.612968 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:57.756615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:57.764425 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6f3e2d7e-076d-4e77-9995-c9a539a9b00e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.169309 Sep 13 13:14:57.764982 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 555/1127] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:57 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:14:58.392232 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1ad057-3065-45e6-91c9-fb4a53f79abb", "name": "network-vif-plugged", "status": "completed", "tag": "bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:14:58.411645 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:58.412266 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:58.413303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:58.426119 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] Creating event network-vif-plugged:bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7 for instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb on hv-cinder-80135 Sep 13 13:14:58.436515 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-438d9d91-6ef0-40d1-9294-0347e71f430c req-17179b32-9bf5-4ea6-98f9-6f4ebd7e85e0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047518 Sep 13 13:14:58.440879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 573/1128] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:14:58.789731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:14:58.790424 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:14:58.797992 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:58.798834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:58.799539 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:58.800568 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:14:58.801354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:14:58.802767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:14:59.209005 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:14:59.217685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-6aa4ca29-3f6c-49a5-9e29-48890b65a7ed tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.432482 Sep 13 13:14:59.218362 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 556/1129] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:14:58 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:00.000638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:15:00.022936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:00.027502 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:00.031523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:00.047497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:00.050126 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] Creating event network-changed:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:15:00.056419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-fec8bc6a-685c-47d8-9058-506518894016 req-30dd6fb1-aee5-4602-b264-24a31392eff7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060341 Sep 13 13:15:00.058299 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 574/1130] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:15:00.245241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:00.246250 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:00.253640 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:00.254396 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:00.254956 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:00.256664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:00.257340 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:00.257914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:00.460868 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:00.469506 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d5692af2-d578-40d8-b898-dbcdb9e00e60 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1265 microversion: 2.1 time: 0.229871 Sep 13 13:15:00.470226 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 557/1131] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:00 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:01.497514 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:01.498319 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:01.506563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:01.507315 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:01.508853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:01.508853 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:01.509560 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:01.510189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:01.785252 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:01.798238 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-4a9c9b8f-b008-4631-a53a-b964a5e291ef tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1453 microversion: 2.1 time: 0.305573 Sep 13 13:15:01.805910 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 575/1132] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:01 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1453 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:01.826484 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:01.827433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:01.834156 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:01.855355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:01.856491 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:01.857893 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:01.860433 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:01.861852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:01.864216 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:02.052722 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:02.061767 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ebedd62f-a77d-4d1f-8aad-fe188a8e84d7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1453 microversion: 2.1 time: 0.240453 Sep 13 13:15:02.063108 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 558/1133] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:01 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:02.932347 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-43151909"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:15:02.934802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:02.951075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:02.952199 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:02.952894 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:02.954151 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:02.955211 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:02.955883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:03.249510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Adding security group ae97b5bc-d0be-4986-a78e-e79813ea3e32 to port 38092063-8ac8-4d3f-bfeb-e77fdc56299a Sep 13 13:15:03.975679 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b2ce91af-18f9-404b-a1ba-6bda5a0ff7ab tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action" status: 202 len: 0 microversion: 2.1 time: 1.053222 Sep 13 13:15:03.976682 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 576/1134] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:15:02 2022] POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:15:03.985083 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:03.985723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:04.002303 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:15:04.008120 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:04.008743 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:04.009187 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:04.009948 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:04.010592 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:04.011021 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:04.022273 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:04.022748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:04.025918 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:04.071897 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] Creating event network-changed:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:15:04.096981 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ed8ff5d2-8294-4e63-979c-c1b5f1d3f02d req-31673f29-915e-4bcb-905d-60e13a46bcf6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102328 Sep 13 13:15:04.101339 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 577/1135] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:15:04.537401 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:04.578843 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ee3cba42-7a1f-41b4-a793-52c831ed93f6 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1758 microversion: 2.1 time: 0.597635 Sep 13 13:15:04.581230 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 559/1136] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:03 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1758 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:06.126043 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f1ad057-3065-45e6-91c9-fb4a53f79abb", "tag": "bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:15:06.136611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:06.137201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:06.137774 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:06.149285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] Creating event network-changed:bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7 for instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb on hv-cinder-80135 Sep 13 13:15:06.154633 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-d94d55e1-a5db-4e0b-8023-b7e52d98adb9 req-01a95468-f6af-4fa8-bed2-8bf94d5f0b1c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 Sep 13 13:15:06.155214 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 578/1137] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:15:27.201690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:15:27.204033 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:27.206644 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:27.207307 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=33 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:27.212191 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:27.217011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:27.217011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:27.217011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:27.217011 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:27.217439 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:27.453664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8bb3dcee-b8e9-4152-9ed6-961e423958a1 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action" status: 202 len: 0 microversion: 2.1 time: 0.255586 Sep 13 13:15:27.454324 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 560/1138] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:15:27 2022] POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:15:27.460970 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=13 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:27.463430 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:15:27.466067 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:27.466757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:27.472827 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:27.473306 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:27.473771 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:27.474459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:27.475706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:27.476139 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:27.632343 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:27.641623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9166fc46-2b31-4e13-bac5-6db840786651 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1750 microversion: 2.1 time: 0.181960 Sep 13 13:15:27.645795 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 579/1139] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:27 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:28.667889 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:28.668587 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:28.675129 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:28.675608 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:28.676043 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:28.676730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:28.677177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:28.677595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:28.818262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:28.826993 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2714c24b-6b3f-433c-9298-37a4d9c43037 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.163293 Sep 13 13:15:28.827552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 561/1140] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:28 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:29.850799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:29.881665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:29.881665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:29.881665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:29.881665 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:29.882291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:29.882291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:29.882291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:30.004459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:30.013286 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-db793117-29de-4d0e-ae29-3f7115d3f299 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.166429 Sep 13 13:15:30.013886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 580/1141] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:29 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:31.038680 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:31.039290 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:31.045727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:31.046233 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:31.046666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:31.047349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:31.047799 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:31.048220 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:31.186272 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:31.195214 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-f3c97c9f-c1c9-4f42-a5d5-5faab5957638 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.161070 Sep 13 13:15:31.195779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 562/1142] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:31 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:32.219070 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:32.219674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:32.226610 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:32.227091 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:32.227526 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:32.228210 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:32.228657 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:32.229082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:32.370434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:32.378599 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-fadd3f10-4eee-4d4c-b5d3-af1361664574 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.163371 Sep 13 13:15:32.379164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 581/1143] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:32 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:15:33.402653 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:33.403269 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:33.409671 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:33.410185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:33.410624 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:33.411314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:33.411768 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:33.412730 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:33.553949 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:33.562530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-365d15dd-f999-481e-90e3-d43ba6525705 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.164014 Sep 13 13:15:33.563101 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 563/1144] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:33 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:34.586566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:34.587787 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:34.594748 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:34.595242 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:34.595710 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:34.596446 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:34.596905 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:34.597337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:34.740750 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:34.748885 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-eca8ca60-ec37-462a-b866-f7b755e66839 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.167386 Sep 13 13:15:34.749463 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 582/1145] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:34 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:35.772469 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:35.773064 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:35.779688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:35.780162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:35.780591 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:35.781266 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:35.781716 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:35.782154 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:35.920638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:35.929409 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-700dee68-8f0a-49df-ad2a-64bf94cec863 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.160197 Sep 13 13:15:35.929997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 564/1146] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:35 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:36.952419 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:36.953066 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:36.959549 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:36.960459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:36.960459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:36.961164 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:36.961623 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:36.962085 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:37.102337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:37.110459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b7d19b81-f909-4ccf-99b3-36071e859374 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.161949 Sep 13 13:15:37.111022 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 583/1147] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:36 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:38.134856 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:38.135475 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:38.142027 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:38.142533 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:38.142966 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:38.143651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:38.144104 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:38.144525 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:38.287060 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:38.295688 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b1e54161-438e-4f67-b2c4-484ba1346387 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.165221 Sep 13 13:15:38.296244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 565/1148] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:38 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:39.319864 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:39.320422 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:39.326803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:39.327288 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:39.327730 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:39.328423 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:39.328879 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:39.329307 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:39.472580 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:39.481093 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9cfd79f9-271d-42fd-91c9-a728a41320d0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1755 microversion: 2.1 time: 0.165238 Sep 13 13:15:39.489936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 584/1149] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:39 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:15:40.505605 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:15:40.506264 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:15:40.512719 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:40.513202 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:40.513636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:40.514347 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:15:40.514800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:15:40.515252 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:15:40.663769 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:15:40.671939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-58c1d23c-2f56-4261-98cd-a3716ab99f0b tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1758 microversion: 2.1 time: 0.170192 Sep 13 13:15:40.672501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 566/1150] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:15:40 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:16:13.094674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-43151909"}} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:16:13.095300 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:13.097475 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=12 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:16:13.098276 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=36 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:16:13.103476 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:13.110352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:13.110352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:13.110352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:13.110352 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:13.110781 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:13.299447 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.network.security_group_api [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Removing security group ae97b5bc-d0be-4986-a78e-e79813ea3e32 from port 38092063-8ac8-4d3f-bfeb-e77fdc56299a Sep 13 13:16:13.669258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-1cc342d8-795c-4033-b1b8-ee0d89420865 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action" status: 202 len: 0 microversion: 2.1 time: 0.577842 Sep 13 13:16:13.669258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 585/1151] 10.222.0.72 () {60 vars in 1278 bytes} [Tue Sep 13 13:16:13 2022] POST /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:16:13.678076 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:16:13.678853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:16:13.828339 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:16:13.839209 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:13.839696 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:13.840131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:13.852184 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] Creating event network-changed:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:16:13.857632 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-6e9d0939-2637-4a00-ba46-35b34e43d78b req-72295606-1a7b-4b41-b365-45ffbecd5db2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184562 Sep 13 13:16:13.858429 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 567/1152] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:16:14.838800 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:14.839336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:14.847903 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:16:14.858104 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:14.858739 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:14.859189 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:14.859925 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:14.860374 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:14.860575 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:14.860804 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:14.861261 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:14.861816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:14.873516 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] Creating event network-changed:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:16:14.879024 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-54081ca6-f977-45aa-9193-a994eac21e25 req-eb7f884c-a2d4-4f1b-ba35-49caaa957e8e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035769 Sep 13 13:16:14.879981 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 568/1153] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:16:14.949553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.objects.instance [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lazy-loading 'services' on Instance uuid b275b709-dd0e-41e1-97fe-a6d03678967d {{(pid=121103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:16:15.172994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-895c1d22-130f-45a5-a5d0-1190fe712efe tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments/7f3ca0e7-475d-4284-8570-2e7c2ead93f9" status: 202 len: 0 microversion: 2.1 time: 0.338883 Sep 13 13:16:15.179812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 586/1154] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:16:14 2022] DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments/7f3ca0e7-475d-4284-8570-2e7c2ead93f9 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 13:16:15.185394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:15.188323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:15.196701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:15.197251 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:15.197922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:15.198626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:15.199085 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:15.199508 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:15.231642 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-93597fe1-5b2f-4cb3-8e56-5294584917f0 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050957 Sep 13 13:16:15.232210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 569/1155] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:16:15 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:16:16.245605 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:16.247984 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:16.254194 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:16.254673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:16.255109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:16.255788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:16.256235 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:16.256663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:16.285111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e20ae206-2b5f-4d1e-97c2-e2fbf2600b4c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045070 Sep 13 13:16:16.285667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 587/1156] 10.222.0.72 () {58 vars in 1302 bytes} [Tue Sep 13 13:16:16 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 13:16:16.296886 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:16.297411 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:16.304607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:16.305089 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:16.305524 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:16.306326 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:16.306779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:16.307204 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:16.381666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] HTTP exception thrown: Instance b275b709-dd0e-41e1-97fe-a6d03678967d is not attached to volume 7f3ca0e7-475d-4284-8570-2e7c2ead93f9 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Request method failure captured: Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments/7f3ca0e7-475d-4284-8570-2e7c2ead93f9 HTTP/1.1 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIITlHWvzMKB2PFQdQVePuuErUp0gebtMrQnVXIkqMmvfCT_yXUzJWNJAsjwgPPLzncT8nV5KGz-8uXitTIwqaYoTZVK5KGg0UL6OjgvbeEzQJoFRQtZe-zRcLeS46rFQmQGlmTiTmp616R3o9VY6jtryeSnq-bkv2SW92oRo6N-lLQ Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: aa5bc3bf3bb74d6a91e79dd861d0563f Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:16:16.384723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_aa5bc3bf3bb74d6a91e79dd861d0563f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: aa5bc3bf3bb74d6a91e79dd861d0563f Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-TestMinimumBasicScenario-1444390795-project Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: ede50e164bea4a89a28e50243d145447 Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-TestMinimumBasicScenario-1444390795-project Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:16:16.386665 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance b275b709-dd0e-41e1-97fe-a6d03678967d is not attached to volume 7f3ca0e7-475d-4284-8570-2e7c2ead93f9 Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'server_id': 'b275b709-dd0e-41e1-97fe-a6d03678967d', 'id': '7f3ca0e7-475d-4284-8570-2e7c2ead93f9'} Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f3ca0e7-475d-4284-8570-2e7c2ead93f9. Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:16:16.387629 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b275b709-dd0e-41e1-97fe-a6d03678967d is not attached to volume 7f3ca0e7-475d-4284-8570-2e7c2ead93f9 Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b275b709-dd0e-41e1-97fe-a6d03678967d is not attached to volume 7f3ca0e7-475d-4284-8570-2e7c2ead93f9 Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:16.389345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Returning 404 to user: Instance b275b709-dd0e-41e1-97fe-a6d03678967d is not attached to volume 7f3ca0e7-475d-4284-8570-2e7c2ead93f9 {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:16:16.390651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-882f982e-45aa-434a-bfe9-d9f997e0d380 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments/7f3ca0e7-475d-4284-8570-2e7c2ead93f9" status: 404 len: 154 microversion: 2.1 time: 0.093403 Sep 13 13:16:16.390651 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 570/1157] 10.222.0.72 () {58 vars in 1416 bytes} [Tue Sep 13 13:16:16 2022] DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d/os-volume_attachments/7f3ca0e7-475d-4284-8570-2e7c2ead93f9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:16:17.690926 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:17.691417 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:17.698082 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:17.698562 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:17.698993 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:17.699673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:17.700123 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:17.700542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:17.724274 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Going to try to terminate instance {{(pid=121103) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:16:17.997206 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6c6aa8db-3222-4403-a953-f3b4ad9fc63c tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 204 len: 0 microversion: 2.1 time: 0.309694 Sep 13 13:16:17.997828 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 588/1158] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:16:17 2022] DELETE /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:16:18.005969 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:18.006638 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:18.013687 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:18.014198 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:18.014626 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:18.015421 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:18.015869 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:18.016297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:18.149041 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:16:18.157137 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0d2df0c5-9df4-4ec1-a612-3cf1ed953581 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1554 microversion: 2.1 time: 0.155039 Sep 13 13:16:18.157697 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 571/1159] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:16:18 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:16:19.182443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:19.183175 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:19.189596 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:19.190111 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:19.190550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:19.191231 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:19.191684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:19.192107 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:19.320094 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:16:19.327796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e1fcb0d4-bef9-4a23-8881-1b1d09c21607 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1554 microversion: 2.1 time: 0.150088 Sep 13 13:16:19.328359 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 589/1160] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:16:19 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:16:20.224727 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b275b709-dd0e-41e1-97fe-a6d03678967d", "name": "network-vif-deleted", "tag": "38092063-8ac8-4d3f-bfeb-e77fdc56299a"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:16:20.235228 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:20.235712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:20.236145 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:20.248092 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] Creating event network-vif-deleted:38092063-8ac8-4d3f-bfeb-e77fdc56299a for instance b275b709-dd0e-41e1-97fe-a6d03678967d on hv-cinder-80135 Sep 13 13:16:20.253354 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-93bdd305-a68c-435f-b2f7-c7e9a07054ca req-165b7a95-7b7f-4ae5-8dd5-4f55e179a016 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Sep 13 13:16:20.254012 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 572/1161] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:16:20.352480 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:20.353201 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:20.359489 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:20.359971 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:20.360407 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:20.361092 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:20.361540 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:20.362044 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:20.424176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede50e164bea4a89a28e50243d145447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5bc3bf3bb74d6a91e79dd861d0563f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:16:20.432523 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-59f4efee-6425-4fc9-8545-4720d1c0c12f tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 200 len: 1343 microversion: 2.1 time: 0.084311 Sep 13 13:16:20.433090 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 590/1162] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:16:20 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 1343 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:16:21.457442 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:21.458300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [instance: b275b709-dd0e-41e1-97fe-a6d03678967d] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:16:21.466764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:21.467379 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:21.467959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:21.468986 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:16:21.469564 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:16:21.470088 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:16:21.487393 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] HTTP exception thrown: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Request method failure captured: Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d HTTP/1.1 Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIITlHWvzMKB2PFQdQVePuuErUp0gebtMrQnVXIkqMmvfCT_yXUzJWNJAsjwgPPLzncT8nV5KGz-8uXitTIwqaYoTZVK5KGg0UL6OjgvbeEzQJoFRQtZe-zRcLeS46rFQmQGlmTiTmp616R3o9VY6jtryeSnq-bkv2SW92oRo6N-lLQ Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: aa5bc3bf3bb74d6a91e79dd861d0563f Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:16:21.489382 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_aa5bc3bf3bb74d6a91e79dd861d0563f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/aa5bc3bf3bb74d6a91e79dd861d0563f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: aa5bc3bf3bb74d6a91e79dd861d0563f Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1444390795 Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-TestMinimumBasicScenario-1444390795-project Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: ede50e164bea4a89a28e50243d145447 Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-TestMinimumBasicScenario-1444390795-project Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. Sep 13 13:16:21.491206 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': 'b275b709-dd0e-41e1-97fe-a6d03678967d'} Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:16:21.492212 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. Sep 13 13:16:21.493852 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:16:21.495602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Returning 404 to user: Instance b275b709-dd0e-41e1-97fe-a6d03678967d could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:16:21.495602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-72b4f0cb-4aed-4c7e-81db-aeed06a7f6e3 tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d" status: 404 len: 111 microversion: 2.1 time: 0.038790 Sep 13 13:16:21.495602 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 573/1163] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:16:21 2022] GET /compute/v2.1/servers/b275b709-dd0e-41e1-97fe-a6d03678967d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:16:21.511841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-8e2fafad-33e8-4c46-a6c2-6dd0eb0f2e8d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] Calling method '.version_select at 0x7f1564fcdaf0>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:16:21.516496 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e2fafad-33e8-4c46-a6c2-6dd0eb0f2e8d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [4e809e2e-4d13-4eb4-87a8-1b4ea8befa18] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 13:16:22.523706 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e2fafad-33e8-4c46-a6c2-6dd0eb0f2e8d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] [4e809e2e-4d13-4eb4-87a8-1b4ea8befa18] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 44108. Sep 13 13:16:22.604782 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-8e2fafad-33e8-4c46-a6c2-6dd0eb0f2e8d tempest-TestMinimumBasicScenario-1444390795 tempest-TestMinimumBasicScenario-1444390795-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1308165583" status: 202 len: 0 microversion: 2.1 time: 1.096635 Sep 13 13:16:22.605398 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 591/1164] 10.222.0.72 () {58 vars in 1272 bytes} [Tue Sep 13 13:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1308165583 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 13:17:02.719185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:02.719822 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:02.722040 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=14 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:02.722683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=26 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:02.727263 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:02.727777 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:02.728210 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:02.728888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:02.729345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:02.729778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:02.756785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:17:03.031075 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-849f6f1a-6893-446a-8c78-b114be722fb9 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 204 len: 0 microversion: 2.1 time: 0.315427 Sep 13 13:17:03.031672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 574/1165] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:17:02 2022] DELETE /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:17:03.037385 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:03.038176 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:03.042011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:03.046077 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:03.049297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:03.049809 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:03.050249 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:03.050950 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:03.051459 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:03.051882 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:03.186196 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:03.193747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-19ea32df-5687-4845-8b9f-10c1f59bbfcb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1578 microversion: 2.1 time: 0.157912 Sep 13 13:17:03.194316 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 592/1166] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:03 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:04.217167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:04.217891 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:04.224428 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:04.224910 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:04.225349 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:04.226070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:04.226529 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:04.226950 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:04.360659 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:04.368309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-014bc003-ae75-43f7-86f5-192d011d7948 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1578 microversion: 2.1 time: 0.155616 Sep 13 13:17:04.372599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 575/1167] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:04 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:05.391255 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:05.392069 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:05.401332 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:05.401841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:05.402280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:05.402985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:05.404452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:05.404883 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:05.428244 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1ad057-3065-45e6-91c9-fb4a53f79abb", "name": "network-vif-deleted", "tag": "bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7"}]} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:17:05.439634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:05.440372 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:05.440990 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:05.453578 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.compute.server_external_events [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] Creating event network-vif-deleted:bc1ba57c-61fd-4ddc-936e-ecbcd79cffa7 for instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb on hv-cinder-80135 Sep 13 13:17:05.458705 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [req-57f46d00-2dbf-4c62-9378-a7b4e61a97d6 req-b09e84ee-cc5d-4682-9578-9a5d3a976f54 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034295 Sep 13 13:17:05.459314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 576/1168] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:17:05.496937 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:05.506747 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b5787856-68b9-4b4b-9f6d-cfe677804d56 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1512 microversion: 2.1 time: 0.119417 Sep 13 13:17:05.507272 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 593/1169] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:05 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1512 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:06.532039 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:06.532741 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:06.539939 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:06.540431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:06.540872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:06.541580 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:06.542062 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:06.542487 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:06.577057 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:06.577538 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:06.577997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:06.578445 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.objects.instance [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lazy-loading 'fault' on Instance uuid 2f1ad057-3065-45e6-91c9-fb4a53f79abb {{(pid=121102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 13:17:06.619594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:06.627494 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-816b267f-6e57-4a7f-85cd-3314cee6cdc2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 200 len: 1231 microversion: 2.1 time: 0.100316 Sep 13 13:17:06.628065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 577/1170] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:06 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:07.652667 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:07.653815 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:07.661959 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:07.662452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:07.662893 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:07.663626 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:07.664039 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:07.664469 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:07.678638 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] HTTP exception thrown: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Request method failure captured: Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb HTTP/1.1 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIIfucikR--X3ktHOxhVM346rLR4B8EgeAbHQO59PMT2TIu4OtZ5JrTsZJ_VeIpcRDorX2Au72i-er7iOenPl54Ay9o_Qfu6FbPr3-ImbbSQXRByXjDonQkbDl0DyiPzucMwiSBTTiwRz2Uo0YzKb6pOnoQR9mKzzb-cEuPIBBgNZ54 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:17:07.680285 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bdc958fc46ca40afa50f4e7f43a0ffe1", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 44492f86f0cb4d4ea1fee7ea2ae7d10f Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:17:07.682159 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '2f1ad057-3065-45e6-91c9-fb4a53f79abb'} Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:17:07.683129 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:17:07.684866 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:17:07.686429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Returning 404 to user: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:17:07.686429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9209a6db-d7c3-4ad3-9a05-25bb29c851d8 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 404 len: 111 microversion: 2.1 time: 0.033777 Sep 13 13:17:07.686429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 594/1171] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:07 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:17:07.779690 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1961190983", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1430276841", "security_groups": [{"name": "tempest-secgroup-smoke-77685047"}], "block_device_mapping_v2": [{"uuid": "2e8847a8-e6fd-49e8-8785-4edf3ba0ddc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:17:07.790176 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 13:17:07.790332 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Tue Sep 13 13:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.72) !!! Sep 13 13:17:07.791330 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 13:17:07.791446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Tue Sep 13 13:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.72) !!! Sep 13 13:17:07.907953 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] validate_networks() for [('0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:17:08.386581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:17:08.387008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:17:08.388091 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:17:08.388502 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:17:08.388913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:17:08.397613 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:08.400297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:08.400297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:08.400297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:08.400297 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:08.400766 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:08.417217 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:17:08.421840 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for user 44492f86f0cb4d4ea1fee7ea2ae7d10f and project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:17:08.487044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:17:08.487044 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e8847a8-e6fd-49e8-8785-4edf3ba0ddc2',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:17:08.951072 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-10913563-46c8-423c-acc5-fa903b9876da tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.176690 Sep 13 13:17:08.951800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 578/1172] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:17:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:17:08.962843 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-5b6c8ef6-f633-482b-916f-dcb6b62797d5 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:08.963506 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-5b6c8ef6-f633-482b-916f-dcb6b62797d5 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:09.018239 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-5b6c8ef6-f633-482b-916f-dcb6b62797d5 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:09.025379 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-5b6c8ef6-f633-482b-916f-dcb6b62797d5 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1095 microversion: 2.1 time: 0.066472 Sep 13 13:17:09.025962 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 595/1173] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:08 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:17:10.049323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:10.049959 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:10.056684 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:10.057112 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:10.057546 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:10.058262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:10.058712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:10.059407 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:10.120872 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:10.129676 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d846ecc5-6abf-4cc4-bb14-9cdef22c298c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1145 microversion: 2.1 time: 0.084978 Sep 13 13:17:10.130308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 579/1174] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:10 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:11.152728 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:11.154570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:11.162668 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:11.163170 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:11.163618 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:11.164393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:11.164863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:11.165300 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:11.242865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:11.250648 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6acac224-0a6f-4fae-b6f2-f4e168b2b66d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1211 microversion: 2.1 time: 0.102162 Sep 13 13:17:11.251213 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 596/1175] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:11 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:12.274656 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:12.275446 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:12.282124 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:12.282689 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:12.283123 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:12.283806 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:12.284252 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:12.284666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:12.497693 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:12.505664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ff9e3971-36aa-4895-a07b-df69f08cbe6d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.235098 Sep 13 13:17:12.506273 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 580/1176] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:12 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:12.685393 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a34563-6aef-4f07-a259-202d9c587f57", "tag": "fef93b7a-6edc-45e4-8e94-f08bbea32bea"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:17:12.696047 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:12.696516 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:12.696947 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:12.708147 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] Creating event network-changed:fef93b7a-6edc-45e4-8e94-f08bbea32bea for instance 69a34563-6aef-4f07-a259-202d9c587f57 on hv-cinder-80135 Sep 13 13:17:12.713297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-0d2c8270-b168-48f3-a62f-0b38f502ff04 req-04231e6b-aa80-4194-be7a-f6ab73faae2e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 Sep 13 13:17:12.714032 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 597/1177] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:17:13.528563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:13.529167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:13.536501 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:13.536980 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:13.537408 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:13.538121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:13.538566 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:13.538984 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:13.666199 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:13.673973 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-b23efafa-ef27-44a9-825d-217d40f1a533 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.149185 Sep 13 13:17:13.674532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 581/1178] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:13 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:14.697432 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:14.698165 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:14.704443 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:14.704923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:14.705361 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:14.706095 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:14.706550 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:14.706976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:14.838499 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:14.846542 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e5d83763-2d56-4bca-b8dc-9e79dfc9f41c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.153845 Sep 13 13:17:14.847098 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 598/1179] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:14 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:15.868547 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:15.869146 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:15.876271 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:15.876746 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:15.877180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:15.877895 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:15.878344 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:15.878761 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:16.006323 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:16.013945 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-51d59281-89e9-4589-a9f8-c5f93105125d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.149187 Sep 13 13:17:16.014505 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 582/1180] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:15 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:17.036991 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:17.037611 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:17.044145 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:17.044629 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:17.045068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:17.045774 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:17.046282 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:17.046889 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:17.178098 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:17.185684 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6750585a-893d-4b8e-a762-2b5650ec159b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.152602 Sep 13 13:17:17.186293 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 599/1181] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:17 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:18.209356 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:18.210019 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:18.216348 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:18.216831 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:18.217431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:18.218803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:18.219426 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:18.219607 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:18.351118 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:18.358828 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70993355-5ff1-4b78-814c-ea190b32fc04 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.153243 Sep 13 13:17:18.359376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 583/1182] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:18 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:19.381941 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:19.382510 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:19.384951 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=2 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:19.389723 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:19.390839 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:19.391280 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:19.391976 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:19.392435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:19.392859 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:19.530886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:19.534870 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-396953b8-12eb-49b1-891a-bc3cead3864b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.156862 Sep 13 13:17:19.535434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 600/1183] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:19 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:20.557013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:20.557717 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:20.559800 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:20.560590 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=6 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:17:20.566611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:20.567093 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:20.567530 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:20.568215 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:20.568744 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:20.569167 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:20.700853 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:20.709232 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d4af11ce-17dd-439c-9740-b106fa0dd5cb tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.156172 Sep 13 13:17:20.709813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 584/1184] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:20 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:21.732337 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:21.732955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:21.739939 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:21.740425 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:21.740863 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:21.741552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:21.742030 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:21.742458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:21.867429 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:21.875431 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-6e0672b9-32e5-49bb-a39e-a5cda7284fe6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.146661 Sep 13 13:17:21.876122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 601/1185] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:21 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:22.898360 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:22.899160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:22.905221 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:22.905712 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:22.906225 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:22.906919 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:22.907376 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:22.907803 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:23.047914 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:23.055604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ddced52e-dfe9-4ac7-a9f6-e3805c7235ec tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.161903 Sep 13 13:17:23.056170 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 585/1186] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:22 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:23.312127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a34563-6aef-4f07-a259-202d9c587f57", "name": "network-vif-plugged", "status": "completed", "tag": "fef93b7a-6edc-45e4-8e94-f08bbea32bea"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:17:23.321931 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:23.322411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:23.322842 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:23.334579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] Creating event network-vif-plugged:fef93b7a-6edc-45e4-8e94-f08bbea32bea for instance 69a34563-6aef-4f07-a259-202d9c587f57 on hv-cinder-80135 Sep 13 13:17:23.339573 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f29ea956-712d-49db-ac13-5a9e789dfa9a req-0dc3e224-955f-493e-bea4-44f2fcb7bf00 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147347 Sep 13 13:17:23.340311 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 602/1187] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:17:24.079555 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:24.080166 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:24.086588 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:24.087067 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:24.087497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:24.088180 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:24.088628 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:24.089082 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:24.227015 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:24.231503 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-26263166-e4cb-45f1-9dfc-d16511701ae1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1265 microversion: 2.1 time: 0.156563 Sep 13 13:17:24.232070 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 586/1188] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:24 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:25.255670 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:25.256378 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:25.263068 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:25.263553 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:25.263996 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:25.264691 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:25.265148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:25.265576 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:25.393891 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:25.401951 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-011906cb-ebf3-4ce5-b845-df1223836b6e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1453 microversion: 2.1 time: 0.150435 Sep 13 13:17:25.402516 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 603/1189] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:25 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:25.423724 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:17:25.424337 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:17:25.430668 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:25.431152 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:25.431594 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:25.432278 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:25.432733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:25.433155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:25.561237 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:17:25.569336 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4996823e-1157-45b3-bad5-bdfb23f32f09 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1453 microversion: 2.1 time: 0.149383 Sep 13 13:17:25.569932 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 587/1190] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:17:25 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:17:27.783322 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a34563-6aef-4f07-a259-202d9c587f57", "tag": "fef93b7a-6edc-45e4-8e94-f08bbea32bea"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:17:27.793228 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:17:27.793704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:17:27.794163 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:17:27.805118 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] Creating event network-changed:fef93b7a-6edc-45e4-8e94-f08bbea32bea for instance 69a34563-6aef-4f07-a259-202d9c587f57 on hv-cinder-80135 Sep 13 13:17:27.809911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-6c26c0e4-d346-47c7-b1bb-65b59f4a70a0 req-d98c3dcb-4032-4042-80d4-2a7b9efb202a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030965 Sep 13 13:17:27.810729 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 604/1191] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:19:03.627639 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:03.628414 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:03.633355 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1259354044", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1430276841", "security_groups": [{"name": "tempest-secgroup-smoke-77685047"}], "block_device_mapping_v2": [{"uuid": "ea8e514b-bf3c-494a-b756-56cc213f6b54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3"}]}} {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:19:03.745694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.network.neutron [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] validate_networks() for [('0e6b48ae-5b08-487c-bab6-0ac0eb7e5db3', None, None, None, None, None)] {{(pid=121102) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 13:19:04.107862 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 13:19:04.108281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image limits 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 13:19:04.108749 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Flavor pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 13:19:04.109171 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Image pref 0:0:0 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 13:19:04.109551 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.virt.hardware [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 13:19:04.118229 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:04.118706 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:04.119138 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:04.119855 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:04.120302 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:04.120721 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:04.136925 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 13:19:04.140672 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.quota [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Getting quotas for user 44492f86f0cb4d4ea1fee7ea2ae7d10f and project bdc958fc46ca40afa50f4e7f43a0ffe1. Resources: {'instances', 'cores', 'ram'} {{(pid=121102) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 13:19:04.198173 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Going to run 1 instances... {{(pid=121102) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 13:19:04.200235 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea8e514b-bf3c-494a-b756-56cc213f6b54',volume_size=None,volume_type=None)] {{(pid=121102) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 13:19:04.587135 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-52e98a31-ade3-4da8-b734-602a114fbe41 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.961143 Sep 13 13:19:04.587784 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 588/1192] 10.222.0.72 () {60 vars in 1147 bytes} [Tue Sep 13 13:19:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 13:19:04.597244 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=28 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:04.598011 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=56 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:04.603403 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d9debe22-cf29-4c19-b28d-f207ff311c0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:04.604073 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d9debe22-cf29-4c19-b28d-f207ff311c0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:04.661309 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d9debe22-cf29-4c19-b28d-f207ff311c0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:04.668462 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d9debe22-cf29-4c19-b28d-f207ff311c0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1095 microversion: 2.1 time: 0.073376 Sep 13 13:19:04.669020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 605/1193] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:04 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:05.691596 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-72dba955-c291-4221-b357-33963de83cfe tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:05.692390 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-72dba955-c291-4221-b357-33963de83cfe tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:05.744788 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-72dba955-c291-4221-b357-33963de83cfe tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:05.751631 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-72dba955-c291-4221-b357-33963de83cfe tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1095 microversion: 2.1 time: 0.064493 Sep 13 13:19:05.752188 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 589/1194] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:05 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:19:06.774876 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-d4dd18da-00b8-4cf8-90e9-d4595edc0295 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:06.775485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-d4dd18da-00b8-4cf8-90e9-d4595edc0295 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:06.831420 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-d4dd18da-00b8-4cf8-90e9-d4595edc0295 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:06.839020 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-d4dd18da-00b8-4cf8-90e9-d4595edc0295 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1095 microversion: 2.1 time: 0.069324 Sep 13 13:19:06.839583 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 606/1195] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:06 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:07.861520 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-70262e28-f942-4c20-8711-ead83e1c3c9d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:07.862162 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-70262e28-f942-4c20-8711-ead83e1c3c9d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:07.914846 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-70262e28-f942-4c20-8711-ead83e1c3c9d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:07.921830 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-70262e28-f942-4c20-8711-ead83e1c3c9d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1095 microversion: 2.1 time: 0.064180 Sep 13 13:19:07.922394 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 590/1196] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:07 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:08.946792 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:08.947353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:08.954436 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:08.954932 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:08.955372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:08.956075 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:08.956536 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:08.956994 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:09.024571 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:09.032589 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-e58be7a2-fce0-4dab-bed0-7cb9c22d2b92 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1145 microversion: 2.1 time: 0.091372 Sep 13 13:19:09.033155 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 607/1197] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:08 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:10.056130 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:10.056739 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:10.063750 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:10.065333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:10.065333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:10.065333 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:10.066025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:10.066461 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:10.128816 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:10.137121 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-77e0c907-aa72-41d3-a4d0-30e76cc8ecf2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1137 microversion: 2.1 time: 0.085514 Sep 13 13:19:10.137683 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 591/1198] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:10 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:11.160338 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:11.160935 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:11.167236 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:11.167722 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:11.168160 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:11.168880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:11.169336 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:11.169788 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:11.232617 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:11.240148 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-b709fb5b-a876-4c8f-8876-29cf9094d3a1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1193 microversion: 2.1 time: 0.083685 Sep 13 13:19:11.241038 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 608/1199] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:11 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:12.263008 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:12.264208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:12.271636 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:12.272128 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:12.274465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:12.274465 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:12.274760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:12.274917 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:12.504300 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:12.519729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-2e68272f-718a-4bff-8eeb-6627b970f9b7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1277 microversion: 2.1 time: 0.259049 Sep 13 13:19:12.519729 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 592/1200] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:12 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:19:13.196654 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389dcab2-184f-4879-b9f0-f40faa277b0e", "tag": "beb17a17-8888-4330-abb0-39d55f1e85b9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:19:13.206895 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:13.207600 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:13.207938 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:13.218598 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] Creating event network-changed:beb17a17-8888-4330-abb0-39d55f1e85b9 for instance 389dcab2-184f-4879-b9f0-f40faa277b0e on hv-cinder-80135 Sep 13 13:19:13.223939 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-08211452-df01-43e2-ac93-9a8c1763b932 req-b12285c4-b14e-4f16-adaa-61396e01591f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Sep 13 13:19:13.224955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 609/1201] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:19:13.543552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:13.544193 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:13.550422 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:13.551126 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:13.551563 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:13.552275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:13.552731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:13.553149 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:13.779952 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:13.787658 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-5260e36d-460f-4e59-907a-6e282453098f tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.248022 Sep 13 13:19:13.788863 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 593/1202] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:13 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:14.812009 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:14.812697 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:14.819109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:14.820689 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:14.821137 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:14.821886 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:14.822353 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:14.822821 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:15.220561 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:15.228924 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-3fbe8095-bc36-4904-83b5-c5350430c312 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.421692 Sep 13 13:19:15.229495 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 610/1203] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:14 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:16.251837 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:16.252471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:16.254304 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=2 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:16.260241 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:16.260723 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:16.261157 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:16.261860 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:16.262309 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:16.262731 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:16.389350 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:16.397164 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-db9f0b13-3972-4d24-8663-e9c47fff9902 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.149139 Sep 13 13:19:16.397755 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 594/1204] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:16 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:17.420563 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:17.421178 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:17.423715 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell0:SELECT=4 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:17.428592 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:17.429845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:17.430297 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:17.430992 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:17.431451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:17.431880 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:17.562703 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:17.570488 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-df2c4d99-9955-421e-8a8b-226ee69327de tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.153618 Sep 13 13:19:17.571063 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 611/1205] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:17 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:18.593471 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell0:SELECT=10 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:19:18.651262 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:18.651880 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:18.657839 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:18.658327 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:18.658760 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:18.659448 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:18.659900 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:18.660322 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:18.798922 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:18.806749 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-780bea43-7358-4800-9376-46128e819727 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.218205 Sep 13 13:19:18.807308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 595/1206] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:18 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:19.829007 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:19.829615 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:19.836362 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:19.836868 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:19.837326 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:19.838045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:19.838497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:19.838922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:19.966841 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:19.974577 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-662bb9a4-963a-4482-a264-63055a1384ce tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.149386 Sep 13 13:19:19.975142 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 612/1207] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:19 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:20.999169 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:20.999779 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:21.006219 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:21.006701 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:21.007131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:21.007888 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:21.008314 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:21.008732 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:21.135294 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:21.142896 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-cbca7175-0c9b-4765-baf8-549d7896468c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.147590 Sep 13 13:19:21.143455 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 596/1208] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:20 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:22.165936 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:22.166552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:22.172862 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:22.173350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:22.173819 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:22.174512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:22.174969 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:22.175397 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:22.310799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:22.318442 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-7d28b28c-e63a-4606-a27a-006d25b05e28 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.156363 Sep 13 13:19:22.319003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 613/1209] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:22 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:23.341560 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:23.342195 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:23.348673 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:23.349159 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:23.349597 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:23.350312 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:23.350765 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:23.352050 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:23.483431 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:23.491025 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c443e42b-4db5-4c8c-b028-9f923821e52b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.153353 Sep 13 13:19:23.491634 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 597/1210] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:23 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:24.513998 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:24.514604 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:24.521132 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:24.521612 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:24.522072 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:24.522757 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:24.523350 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:24.523783 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:24.656409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:24.664603 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-84c7d7b3-99fd-4e66-b0e1-f07aa0d34ec2 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.154404 Sep 13 13:19:24.665162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 614/1211] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:24 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:25.687325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:25.688009 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:25.694581 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:25.695065 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:25.695694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:25.696386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:25.696842 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:25.697268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:25.890007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:25.891088 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389dcab2-184f-4879-b9f0-f40faa277b0e", "name": "network-vif-plugged", "status": "completed", "tag": "beb17a17-8888-4330-abb0-39d55f1e85b9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:19:25.891997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d37f116d-8880-4369-832d-f07242249d0b tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.158067 Sep 13 13:19:25.891997 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 598/1212] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:25 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:25.892222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:25.892222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:25.892222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:25.892222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] Creating event network-vif-plugged:beb17a17-8888-4330-abb0-39d55f1e85b9 for instance 389dcab2-184f-4879-b9f0-f40faa277b0e on hv-cinder-80135 Sep 13 13:19:25.892222 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-ff1b8639-7b89-4c1d-8fe6-b11ee055df5c req-94e958d6-f297-4071-b1b4-3e64055d2513 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033840 Sep 13 13:19:25.892714 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 615/1213] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:19:26.912275 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:26.912838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:26.919882 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:26.920363 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:26.920793 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:26.921478 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:26.921964 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:26.922386 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:27.053791 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:27.061770 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-c4a5e414-c5e7-499f-ad0e-8d258ae6a50d tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1265 microversion: 2.1 time: 0.153453 Sep 13 13:19:27.062325 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 599/1214] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:26 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:28.084570 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:28.085267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:28.092803 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:28.093512 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:28.093812 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:28.094509 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:28.094961 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:28.095386 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:28.227364 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:28.235915 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-a3ff9cf7-c7cb-4eed-b490-e0742b0f5f2e tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1452 microversion: 2.1 time: 0.155553 Sep 13 13:19:28.236923 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 616/1215] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:28 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:28.257879 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:19:28.258523 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:19:28.265498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:28.266026 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:28.266466 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:28.267155 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:28.267611 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:28.268036 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:28.403158 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:19:28.410771 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-ccc4d706-188a-494b-8d9f-d89d35aadc94 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1452 microversion: 2.1 time: 0.156744 Sep 13 13:19:28.411328 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 600/1216] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:19:28 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:19:30.322333 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389dcab2-184f-4879-b9f0-f40faa277b0e", "tag": "beb17a17-8888-4330-abb0-39d55f1e85b9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:19:30.332524 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:19:30.333003 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:19:30.333434 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:19:30.346796 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] Creating event network-changed:beb17a17-8888-4330-abb0-39d55f1e85b9 for instance 389dcab2-184f-4879-b9f0-f40faa277b0e on hv-cinder-80135 Sep 13 13:19:30.351673 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-bfefea29-86d9-4256-a746-5f1969f2ab1e req-d57846bc-0b88-4914-bf47-cf7bd606a8ca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033089 Sep 13 13:19:30.352451 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 617/1217] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:20:58.463412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:20:58.464617 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG dbcounter [-] [121102] Writing DB stats nova_cell1:SELECT=62 {{(pid=121102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:20:58.466041 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_api:SELECT=30 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:20:58.467013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 13:20:58.467013 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Tue Sep 13 13:20:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e (ip 10.222.0.72) !!! Sep 13 13:20:58.468179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG dbcounter [-] [121103] Writing DB stats nova_cell1:SELECT=54 {{(pid=121103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 13:20:58.469761 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 13:20:58.470026 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Tue Sep 13 13:20:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.72) !!! Sep 13 13:20:58.474661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:20:58.479397 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:20:58.479527 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389dcab2-184f-4879-b9f0-f40faa277b0e", "tag": "beb17a17-8888-4330-abb0-39d55f1e85b9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:20:58.490034 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:20:58.490527 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:20:58.490704 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:20:58.491001 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:20:58.491127 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:20:58.491636 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:20:58.491751 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:20:58.492131 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:20:58.492558 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:20:58.503368 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] Creating event network-changed:beb17a17-8888-4330-abb0-39d55f1e85b9 for instance 389dcab2-184f-4879-b9f0-f40faa277b0e on hv-cinder-80135 Sep 13 13:20:58.508895 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-860b5341-8e5e-429a-97b4-2f336a25dd1d req-0f1b5146-7cb6-445f-ba14-56f03f3680ea service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045050 Sep 13 13:20:58.514031 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 618/1218] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 13:20:58.525281 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:20:58.821165 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-99428827-f3da-4e64-b7ad-7f3261a8825c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "DELETE /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 204 len: 0 microversion: 2.1 time: 0.359927 Sep 13 13:20:58.823936 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 601/1219] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:20:58 2022] DELETE /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:20:58.831738 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:20:58.832457 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:20:58.839913 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:20:58.840415 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:20:58.841062 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:20:58.842934 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:20:58.843408 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:20:58.843847 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:20:59.051756 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:20:59.059578 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-001f3e01-4254-49cc-89a5-b85beafaad22 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1577 microversion: 2.1 time: 0.232287 Sep 13 13:20:59.060174 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 619/1220] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:20:58 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:21:00.085268 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:00.086004 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:00.093007 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:00.093497 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:00.093967 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:00.094664 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:00.095119 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:00.095548 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:00.282782 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:21:00.290615 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-76138181-3918-4d06-945c-e9f4ada287c4 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1577 microversion: 2.1 time: 0.209601 Sep 13 13:21:00.291185 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 602/1221] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:00 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:21:00.903840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389dcab2-184f-4879-b9f0-f40faa277b0e", "name": "network-vif-deleted", "tag": "beb17a17-8888-4330-abb0-39d55f1e85b9"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:21:00.913558 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:00.915955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:00.915955 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:00.925494 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] Creating event network-vif-deleted:beb17a17-8888-4330-abb0-39d55f1e85b9 for instance 389dcab2-184f-4879-b9f0-f40faa277b0e on hv-cinder-80135 Sep 13 13:21:00.930267 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-5b837a11-6fe4-47f8-8373-c9992cff78f8 req-93e835f6-e67e-4569-9c73-ff5112b07fef service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030274 Sep 13 13:21:00.930901 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 620/1222] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:21:01.315751 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:01.316365 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:01.322927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:01.323412 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:01.323848 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:01.324532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:01.324985 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:01.325410 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:01.389811 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:21:01.397927 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-e869091a-acda-44b6-a272-c4d11546b27c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 200 len: 1226 microversion: 2.1 time: 0.085928 Sep 13 13:21:01.398685 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 603/1223] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:01 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:21:02.422421 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:02.423153 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 389dcab2-184f-4879-b9f0-f40faa277b0e] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:02.429258 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:02.429766 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:02.430218 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:02.430911 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:02.431366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:02.431799 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:02.445081 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] HTTP exception thrown: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Request method failure captured: Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e HTTP/1.1 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIIfucikR--X3ktHOxhVM346rLR4B8EgeAbHQO59PMT2TIu4OtZ5JrTsZJ_VeIpcRDorX2Au72i-er7iOenPl54Ay9o_Qfu6FbPr3-ImbbSQXRByXjDonQkbDl0DyiPzucMwiSBTTiwRz2Uo0YzKb6pOnoQR9mKzzb-cEuPIBBgNZ54 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:21:02.446708 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bdc958fc46ca40afa50f4e7f43a0ffe1", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 44492f86f0cb4d4ea1fee7ea2ae7d10f Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. Sep 13 13:21:02.448511 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '389dcab2-184f-4879-b9f0-f40faa277b0e'} Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:21:02.449566 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. Sep 13 13:21:02.451372 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:02.452985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Returning 404 to user: Instance 389dcab2-184f-4879-b9f0-f40faa277b0e could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:21:02.452985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-c1957dd2-df8a-49c2-83f1-e4f587d0bba7 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e" status: 404 len: 111 microversion: 2.1 time: 0.030987 Sep 13 13:21:02.452985 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 621/1224] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:02 2022] GET /compute/v2.1/servers/389dcab2-184f-4879-b9f0-f40faa277b0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:21:05.730498 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:05.731010 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:05.733193 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a34563-6aef-4f07-a259-202d9c587f57", "tag": "fef93b7a-6edc-45e4-8e94-f08bbea32bea"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:21:05.738694 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:05.739181 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:05.739616 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:05.740315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:05.740764 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:05.741189 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:05.743579 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:05.744122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:05.744627 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:05.756329 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] Creating event network-changed:fef93b7a-6edc-45e4-8e94-f08bbea32bea for instance 69a34563-6aef-4f07-a259-202d9c587f57 on hv-cinder-80135 Sep 13 13:21:05.761978 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-f7d1aa7a-6fe4-4ccf-98eb-2751b229b9d9 req-18bbd2b0-4a73-49d8-9215-ed9add39bcb6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033176 Sep 13 13:21:05.762676 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 622/1225] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:21:05.769462 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Going to try to terminate instance {{(pid=121102) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 13:21:06.101419 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-03bcdcb4-e490-4d9d-b577-88826e560359 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "DELETE /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 204 len: 0 microversion: 2.1 time: 0.374607 Sep 13 13:21:06.105338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 604/1226] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:21:05 2022] DELETE /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 13:21:06.111409 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:06.112121 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:06.118435 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:06.118922 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:06.119357 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:06.120045 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:06.120497 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:06.120920 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:06.263552 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.policy [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121103) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:21:06.272162 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-162d4bc4-cf20-474a-9ea0-aae33e3700e1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1577 microversion: 2.1 time: 0.165546 Sep 13 13:21:06.272727 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 623/1227] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:06 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 13:21:07.296661 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:07.297308 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:07.303813 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:07.304295 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:07.304734 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:07.305418 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:07.305913 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:07.306338 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:07.434259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:21:07.441989 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-0e5d2f3e-fdcd-4674-9a97-95c319b18e13 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1459 microversion: 2.1 time: 0.149866 Sep 13 13:21:07.442552 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 605/1228] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:07 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1459 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:21:08.081769 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a34563-6aef-4f07-a259-202d9c587f57", "name": "network-vif-deleted", "tag": "fef93b7a-6edc-45e4-8e94-f08bbea32bea"}]} {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 13:21:08.092458 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:08.092980 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:08.093411 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:08.104565 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.compute.server_external_events [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] Creating event network-vif-deleted:fef93b7a-6edc-45e4-8e94-f08bbea32bea for instance 69a34563-6aef-4f07-a259-202d9c587f57 on hv-cinder-80135 Sep 13 13:21:08.110366 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [req-b71e3182-09c6-49a5-ba40-917553b65012 req-3e1d4584-5412-4a1c-bf9b-b23d44222ebb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032379 Sep 13 13:21:08.111413 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 624/1229] 10.222.0.72 () {64 vars in 1317 bytes} [Tue Sep 13 13:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 13:21:08.466748 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:08.467345 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:08.474604 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:08.475097 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:08.475532 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:08.476259 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:08.476733 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:08.477177 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:08.545256 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.policy [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44492f86f0cb4d4ea1fee7ea2ae7d10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc958fc46ca40afa50f4e7f43a0ffe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121102) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 13:21:08.553132 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-4c3388f4-c8d5-4134-87f9-5d4890c86b48 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 200 len: 1226 microversion: 2.1 time: 0.090983 Sep 13 13:21:08.553702 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 606/1230] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:08 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 13:21:09.577109 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:09.577840 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 69a34563-6aef-4f07-a259-202d9c587f57] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:09.584567 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:09.585056 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:09.585503 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:09.586216 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:09.586674 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:09.587105 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:09.601245 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] HTTP exception thrown: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Request method failure captured: Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 HTTP/1.1 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIIfucikR--X3ktHOxhVM346rLR4B8EgeAbHQO59PMT2TIu4OtZ5JrTsZJ_VeIpcRDorX2Au72i-er7iOenPl54Ay9o_Qfu6FbPr3-ImbbSQXRByXjDonQkbDl0DyiPzucMwiSBTTiwRz2Uo0YzKb6pOnoQR9mKzzb-cEuPIBBgNZ54 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:21:09.617173 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bdc958fc46ca40afa50f4e7f43a0ffe1", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 44492f86f0cb4d4ea1fee7ea2ae7d10f Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. Sep 13 13:21:09.619106 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '69a34563-6aef-4f07-a259-202d9c587f57'} Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:21:09.620533 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. Sep 13 13:21:09.623179 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:09.624663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Returning 404 to user: Instance 69a34563-6aef-4f07-a259-202d9c587f57 could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:21:09.624663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-63633995-7cc7-4971-a870-945a425ab2c1 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57" status: 404 len: 111 microversion: 2.1 time: 0.031499 Sep 13 13:21:09.624663 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 625/1231] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:09 2022] GET /compute/v2.1/servers/69a34563-6aef-4f07-a259-202d9c587f57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:21:10.179315 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:10.179809 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.compute.api [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121102) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:10.186666 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:10.187160 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:10.187595 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:10.188287 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:10.188778 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:10.189208 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG oslo_concurrency.lockutils [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:10.203174 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.wsgi [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] HTTP exception thrown: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Request method failure captured: Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: request: DELETE /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb HTTP/1.1 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept: application/json Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Accept-Encoding: identity Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Connection: close Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Length: 0 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Content-Type: application/json Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Host: 10.222.0.72 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: Openstack-System-Scope: None Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: User-Agent: python-urllib3/1.26.12 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Auth-Token: gAAAAABjIIIfucikR--X3ktHOxhVM346rLR4B8EgeAbHQO59PMT2TIu4OtZ5JrTsZJ_VeIpcRDorX2Au72i-er7iOenPl54Ay9o_Qfu6FbPr3-ImbbSQXRByXjDonQkbDl0DyiPzucMwiSBTTiwRz2Uo0YzKb6pOnoQR9mKzzb-cEuPIBBgNZ54 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Id: None Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Domain-Name: None Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Identity-Status: Confirmed Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Is-Admin-Project: True Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Id: default Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Domain-Name: Default Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Project-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Role: reader,member Sep 13 13:21:10.204834 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Roles: reader,member Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bdc958fc46ca40afa50f4e7f43a0ffe1", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Id: default Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Domain-Name: Default Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Id: 44492f86f0cb4d4ea1fee7ea2ae7d10f Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: X-User-Name: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: method: > Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: exception: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.206599 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: action_args: {'id': '2f1ad057-3065-45e6-91c9-fb4a53f79abb'} Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:21:10.207423 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.208785 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.210579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Returning 404 to user: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. {{(pid=121102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:21:10.210579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-d9d5aaa1-4872-48ef-8357-5a6ad0d39799 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 404 len: 111 microversion: 2.1 time: 0.030785 Sep 13 13:21:10.210579 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 607/1232] 10.222.0.72 () {58 vars in 1239 bytes} [Tue Sep 13 13:21:10 2022] DELETE /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:21:10.214865 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '>' {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:10.215485 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.compute.api [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] [instance: 2f1ad057-3065-45e6-91c9-fb4a53f79abb] Fetching instance by UUID {{(pid=121103) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 13:21:10.222349 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:10.222845 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:10.223291 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:10.223995 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Acquiring lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 13:21:10.224452 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 13:21:10.224912 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG oslo_concurrency.lockutils [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Lock "f147bbc8-2c91-4f66-bc06-a2f2b3222893" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 13:21:10.238862 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.wsgi [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] HTTP exception thrown: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Request method failure captured: Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: request: GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb HTTP/1.1 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept: application/json Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Accept-Encoding: identity Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Connection: close Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Length: 0 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Content-Type: application/json Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Host: 10.222.0.72 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: Openstack-System-Scope: None Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: User-Agent: python-urllib3/1.26.12 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Auth-Token: gAAAAABjIIIfucikR--X3ktHOxhVM346rLR4B8EgeAbHQO59PMT2TIu4OtZ5JrTsZJ_VeIpcRDorX2Au72i-er7iOenPl54Ay9o_Qfu6FbPr3-ImbbSQXRByXjDonQkbDl0DyiPzucMwiSBTTiwRz2Uo0YzKb6pOnoQR9mKzzb-cEuPIBBgNZ54 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Id: None Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Domain-Name: None Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Identity-Status: Confirmed Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Is-Admin-Project: True Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Id: default Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Domain-Name: Default Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Project-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Role: reader,member Sep 13 13:21:10.240763 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Roles: reader,member Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bdc958fc46ca40afa50f4e7f43a0ffe1", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bdc958fc46ca40afa50f4e7f43a0ffe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Id: bdc958fc46ca40afa50f4e7f43a0ffe1 Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389967874 Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Id: default Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Domain-Name: Default Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Id: 44492f86f0cb4d4ea1fee7ea2ae7d10f Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: X-User-Name: tempest-TestVolumeBootPattern-1389967874-project Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: method: > Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: exception: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.243811 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: action_args: {'id': '2f1ad057-3065-45e6-91c9-fb4a53f79abb'} Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: {{(pid=121103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 13:21:10.244802 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. Sep 13 13:21:10.246464 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: ERROR nova.api.openstack.wsgi Sep 13 13:21:10.248122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: DEBUG nova.api.openstack.wsgi [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Returning 404 to user: Instance 2f1ad057-3065-45e6-91c9-fb4a53f79abb could not be found. {{(pid=121103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 13:21:10.248122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: INFO nova.api.openstack.requestlog [None req-9bd9313c-f797-4cf5-99c3-e14a3c7bdc2c tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb" status: 404 len: 111 microversion: 2.1 time: 0.031186 Sep 13 13:21:10.248122 dv-cinder-801354-10-iscsi devstack@n-api.service[121103]: [pid: 121103|app: 0|req: 626/1233] 10.222.0.72 () {58 vars in 1236 bytes} [Tue Sep 13 13:21:10 2022] GET /compute/v2.1/servers/2f1ad057-3065-45e6-91c9-fb4a53f79abb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 13:21:11.791838 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: DEBUG nova.api.openstack.wsgi [None req-8c366e7f-ee85-4f49-b5c0-695dd26391d6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] Calling method '.version_select at 0x7f1564f7daf0>' {{(pid=121102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 13:21:11.879457 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: INFO nova.api.openstack.requestlog [None req-8c366e7f-ee85-4f49-b5c0-695dd26391d6 tempest-TestVolumeBootPattern-1389967874 tempest-TestVolumeBootPattern-1389967874-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1430276841" status: 202 len: 0 microversion: 2.1 time: 0.091387 Sep 13 13:21:11.880030 dv-cinder-801354-10-iscsi devstack@n-api.service[121102]: [pid: 121102|app: 0|req: 608/1234] 10.222.0.72 () {58 vars in 1263 bytes} [Tue Sep 13 13:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1430276841 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)